00000001:02000400:1.0F:1783349660.952084:0:2965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1783349671.384278:0:3168:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1783349672.394745:0:3228:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1203 MB/s 00000001:01000000:2.0F:1783349672.644189:0:3228:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1139 MB/s 00000001:01000000:2.0:1783349672.893837:0:3228:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8751 MB/s 00000020:02000000:0.0F:1783349673.286291:0:3260:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_84_g95d2d66 00000400:02000000:3.0:1783349673.797341:0:3275:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.136@tcp [8/256/0/180] 00008000:02000000:2.0:1783349676.697520:0:3424:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783349703.725402:0:5228:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783349708.396023:0:5765:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783349708.396028:0:5765:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783349708.396153:0:5765:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f6768dd3 00000080:02000400:0.0:1783349708.396164:0:5765:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1783349708.399936:0:5765:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1783349708.399950:0:5765:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783349708.399986:0:5765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000025743667) 00000020:00000080:0.0:1783349708.400006:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783349708.414070:0:5765:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783349708.414423:0:5765:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783349708.429927:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1783349708.429962:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1783349708.429980:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1783349708.430025:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783349708.430047:0:5765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1783349708.430362:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783349708.430370:0:5765:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783349708.430379:0:5765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a48475f0f 00000020:01000004:0.0:1783349708.430386:0:5765:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1783349708.430390:0:5765:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783349708.430395:0:5765:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f6768dd3 from MGS 00000020:01000004:0.0:1783349708.430399:0:5765:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783349708.430408:0:5765:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d1df25f2) 00000020:00000080:0.0:1783349708.430417:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783349708.430477:0:5765:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f6768dd3 from MGS, refs=2 00080000:01000000:0.0:1783349708.430482:0:5765:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783349708.430487:0:5765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a48475f1d 00000100:00100000:0.0:1783349708.430586:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783349708.430711:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783349708.430716:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783349708.431259:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783349708.431266:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783349708.432000:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349708.432122:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783349708.432127:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783349708.432654:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783349708.432660:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783349708.432998:0:5765:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783349708.433002:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783349708.433610:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349708.433613:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349708.433615:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349708.433958:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349708.433960:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349708.433962:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349708.434417:0:5765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783349708.436978:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783349708.683915:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6203 MB/s 00000001:01000000:3.0:1783349708.933861:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7659 MB/s 00000001:01000000:3.0:1783349709.184242:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1367 MB/s 00000001:01000000:3.0:1783349709.434030:0:5765:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1575 MB/s 00080000:10000000:3.0:1783349709.439123:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1783349709.447262:0:5765:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783349709.447279:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783349709.447281:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783349709.449560:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783349709.449622:0:5765:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783349709.449668:0:5765:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1783349709.449942:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783349709.449966:0:5765:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783349709.450279:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783349709.450410:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783349709.450416:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783349709.452786:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783349709.452814:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783349709.453304:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783349709.453311:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783349709.456329:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783349709.456352:0:5765:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.136@tcp' 00000020:01000004:3.0:1783349709.456354:0:5765:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783349709.456400:0:5765:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.136@tcp (typ=mgc) 00000020:00000080:3.0:1783349709.456418:0:5765:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.136@tcp (000000009327ce47) 00000020:00000080:3.0:1783349709.456435:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783349709.456531:0:5765:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000096b37f52@MGC192.168.204.136@tcp: add connection 192.168.204.136@tcp at head 00010000:00010000:3.0:1783349709.456685:0:5765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.136@tcp-0 is initialized 00000040:01000000:3.0:1783349709.456692:0:5765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783349709.456937:0:5780:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783349709.458404:0:5781:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783349709.458454:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.136@tcp (uuid 47d1b48f-2d78-45ee-b062-943ed61d9bed) 00000020:00000080:2.0:1783349709.458474:0:5765:0:(genops.c:1406:class_connect()) connect: client 47d1b48f-2d78-45ee-b062-943ed61d9bed, cookie 0x68b4a22a48475f2b 00000100:00080000:2.0:1783349709.458485:0:5765:0:(import.c:512:import_select_connection()) MGC192.168.204.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349709.458490:0:5765:0:(import.c:626:import_select_connection()) MGC192.168.204.136@tcp: import 0000000096b37f52 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349709.458542:0:5765:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000df7b8cc8 x1869977666715776/t0(0) o250->MGC192.168.204.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349709.458569:0:5765:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 47d1b48f-2d78-45ee-b062-943ed61d9bed->MGS 00000020:01000004:2.0:1783349709.458588:0:5765:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783349709.458594:0:5765:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783349709.458615:0:5765:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009f7696c6) 00000020:00000080:2.0:1783349709.458628:0:5765:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783349709.458640:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000df7b8cc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47d1b48f-2d78-45ee-b062-943ed61d9bed:3290:1869977666715776:0@lo:250: 00000100:00100000:3.0:1783349709.458717:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349709.458766:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666715776 00000100:00100000:0.0:1783349709.458775:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666715776 00000100:00100000:0.0:1783349709.461291:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349709.461302:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fad204e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1869977666715776:12345-0@lo:250: 00010000:00080000:0.0:1783349709.461329:0:5777:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 47d1b48f-2d78-45ee-b062-943ed61d9bed@0@lo t0 exp 0000000000000000 cur 96 last 0 00000020:00000080:0.0:1783349709.461360:0:5777:0:(genops.c:1406:class_connect()) connect: client 47d1b48f-2d78-45ee-b062-943ed61d9bed, cookie 0x68b4a22a48475f39 00000100:00080000:0.0:1783349709.461492:0:5777:0:(import.c:65:import_set_state_nolock()) 000000003313966a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349709.461609:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fad204e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:3290:x1869977666715776:12345-0@lo:250: Request processed in 306us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349709.461618:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349709.461678:0:3290:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783349709.461687:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.136@tcp: connect to target with instance 0 00000100:00080000:0.0:1783349709.461694:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783349709.461699:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783349709.461702:0:3290:0:(import.c:65:import_set_state_nolock()) 0000000096b37f52 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783349709.461705:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783349709.461717:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783349709.461723:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000df7b8cc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47d1b48f-2d78-45ee-b062-943ed61d9bed:3290:1869977666715776:0@lo:250: 00000100:00100000:2.0:1783349709.464431:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349709.464677:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349709.464684:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783349709.466069:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783349709.466079:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783349709.466432:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783349709.466438:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783349709.467146:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349709.467296:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783349709.467306:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783349709.467762:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783349709.467769:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1783349709.482961:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349709.489037:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349709.489242:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783349709.489249:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783349709.489944:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783349709.489956:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783349709.490562:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349709.490697:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783349709.490703:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783349709.491255:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783349709.491262:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783349709.491770:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349709.492007:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783349709.492012:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783349709.492405:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783349709.492412:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783349709.492857:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349709.492931:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783349709.492934:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783349709.493265:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783349709.493271:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783349709.509623:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349709.509914:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349709.509921:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783349709.513111:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783349709.513127:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783349709.514158:0:5765:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783349709.514167:0:5765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783349709.515947:0:5765:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783349709.515977:0:5765:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783349709.515983:0:5765:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783349709.516107:0:5765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783349709.516133:0:5765:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.136@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783349709.516136:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783349709.516137:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349709.516138:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349709.516139:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349709.516140:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349709.516141:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349709.516141:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349709.516142:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349709.516143:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349709.516144:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349709.516145:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349709.516147:0:5765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783349709.516149:0:5765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783349709.516151:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349709.516152:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349709.516152:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349709.516153:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349709.516153:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349709.516154:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349709.516154:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349709.516155:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349709.516155:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349709.516156:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349709.516156:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349709.516157:0:5765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783349709.516177:0:5765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783349709.516189:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666715904:0@lo:253: 00000100:00100000:2.0:1783349709.516251:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.516288:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 0000000090677547 going to sleep for 11 seconds 00000100:00100000:0.0:1783349709.516292:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666715904 00000100:00100000:0.0:1783349709.516304:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666715904 00000100:00100000:0.0:1783349709.516339:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349709.516346:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049d7230b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:5765:x1869977666715904:12345-0@lo:253: 20000000:01000000:0.0:1783349709.516398:0:5779:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783349709.516401:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1783349709.516847:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783349709.516940:0:5779:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783349709.517248:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349709.518593:0:5801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1783349709.518778:0:5779:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783349709.518782:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1783349709.518787:0:5779:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1783349709.518809:0:5779:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1783349709.518828:0:5779:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1783349709.518991:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349709.519237:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1783349709.519249:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783349709.519295:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1783349709.519340:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1783349709.519374:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1783349709.519452:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1783349709.519460:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1783349709.519513:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1783349709.519522:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1783349709.519562:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1783349709.519570:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1783349709.519597:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1783349709.519641:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1783349709.519953:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783349709.519959:0:5779:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1783349709.519973:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349709.520161:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1783349709.520171:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783349709.520205:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1783349709.520239:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1783349709.520282:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1783349709.520293:0:5779:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1783349709.520360:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1783349709.520369:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783349709.520412:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783349709.520474:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783349709.520541:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783349709.520553:0:5779:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783349709.520639:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783349709.520649:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783349709.520755:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783349709.520787:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783349709.520990:0:5779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783349709.521038:0:5779:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783349709.521046:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1783349709.522639:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1783349709.522933:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1783349709.522960:0:5779:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.136@tcp for mdt 20000000:01000000:2.0:1783349709.522962:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.136@tcp (null) (null) (null) 00000040:00080000:2.0:1783349709.522996:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1783349709.523003:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783349709.523030:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1783349709.523046:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.136@tcp (null) (null) 00000040:00080000:2.0:1783349709.523107:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1783349709.523119:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1783349709.523150:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1783349709.523183:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1783349709.523239:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783349709.523243:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783349709.523248:0:5779:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1783349709.523254:0:5779:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783349709.523651:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1783349709.523743:0:5779:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1783349709.528825:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1783349709.528880:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1783349709.528954:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1783349709.528972:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783349709.528974:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783349709.528978:0:5779:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783349709.528991:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783349709.528994:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783349709.529023:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783349709.529026:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783349709.529444:0:5804:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1783349709.529937:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1783349709.529974:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1783349709.530028:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1783349709.530039:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783349709.530041:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783349709.530411:0:5805:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783349709.530937:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783349709.530978:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783349709.531009:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1783349709.531022:0:5779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783349709.531024:0:5779:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1783349709.531036:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783349709.531057:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531074:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531083:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531091:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531097:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531104:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531110:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e92c8cb already unused, calling callback (000000004dc8525f) 00010000:00010000:2.0:1783349709.531114:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531120:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531131:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531138:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.531144:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e92c8cb/0x68b4a22a48475f40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783349709.531165:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783349709.658414:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049d7230b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:5765:x1869977666715904:12345-0@lo:253: Request processed in 142062us (142156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349709.658429:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349709.658517:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666715904:0@lo:253: 10000000:01000000:2.0:1783349709.658579:0:5765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783349709.658582:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349709.658583:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349709.658584:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349709.658585:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783349709.658586:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349709.658586:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349709.658587:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349709.658588:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349709.658589:0:5765:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783349709.658590:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349709.658591:0:5765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783349709.658607:0:5765:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f6768dd3 from lustre-MDT0000 10000000:01000000:2.0:1783349709.658626:0:5765:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783349709.658628:0:5765:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783349709.658631:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9320c75e8000 10000000:01000000:2.0:1783349709.658635:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349709.658640:0:5765:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9320c75e8000 from 1 10000000:01000000:2.0:1783349709.658642:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783349709.658670:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.658677:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.658683:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.658695:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716032:0@lo:101: 00000100:00100000:2.0:1783349709.658732:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.658778:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:0.0:1783349709.659182:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716032 00000100:00100000:0.0:1783349709.659252:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716032 00000100:00100000:0.0:1783349709.659399:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349709.659408:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a5f15cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:5765:x1869977666716032:12345-0@lo:101: 00010000:00010000:0.0:1783349709.659421:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349709.659436:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc30097b/0x68b4a22a48475f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48475f47 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349709.659458:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc30097b/0x68b4a22a48475f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349709.659467:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc30097b/0x68b4a22a48475f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349709.659476:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc30097b, rc 0) 00000100:00100000:0.0:1783349709.659527:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a5f15cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:5765:x1869977666716032:12345-0@lo:101: Request processed in 120us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349709.659533:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349709.659559:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716032:0@lo:101: 00010000:00010000:2.0:1783349709.659573:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.659581:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.659617:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716160:0@lo:501: 00000100:00100000:2.0:1783349709.659635:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.659656:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:0.0:1783349709.659682:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716160 00000100:00100000:0.0:1783349709.659687:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716160 00000100:00100000:0.0:1783349709.659717:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349709.659724:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000125dc9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:5765:x1869977666716160:12345-0@lo:501: 00000100:00100000:0.0:1783349709.659969:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000125dc9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:5765:x1869977666716160:12345-0@lo:501: Request processed in 246us (332us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349709.659977:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349709.659989:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716160:0@lo:501: 10000000:01000000:2.0:1783349709.660010:0:5765:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783349709.660030:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660036:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 000000009e92c8cb/0x68b4a22a48475f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349709.660040:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9320c6fcb000 10000000:01000000:2.0:1783349709.660043:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783349709.660045:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9320c6fcb000 10000000:01000000:2.0:1783349709.660046:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783349709.660048:0:5765:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9320c6fcb000 from 1 10000000:01000000:2.0:1783349709.660049:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783349709.660059:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660071:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660076:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.660083:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716288:0@lo:101: 00000100:00100000:2.0:1783349709.660099:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.660123:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.660539:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716288 00000100:00100000:3.0:1783349709.660544:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716288 00000100:00100000:3.0:1783349709.660572:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349709.660579:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf62f090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:5765:x1869977666716288:12345-0@lo:101: 00010000:00010000:3.0:1783349709.660587:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349709.660597:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d5223db/0x68b4a22a48475f5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48475f55 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.660612:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d5223db/0x68b4a22a48475f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48475f55 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.660620:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d5223db/0x68b4a22a48475f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475f55 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.660627:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d5223db, rc 0) 00000100:00100000:3.0:1783349709.660663:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf62f090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+7:5765:x1869977666716288:12345-0@lo:101: Request processed in 86us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.660669:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349709.660711:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716288:0@lo:101: 00010000:00010000:2.0:1783349709.660719:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660724:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349709.660730:0:5765:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783349709.660740:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660744:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 000000004aacecf2/0x68b4a22a48475f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349709.660748:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783349709.660750:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349709.660753:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9320c6fcb000 10000000:01000000:2.0:1783349709.660754:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783349709.660756:0:5765:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783349709.660762:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783349709.660772:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660776:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.660780:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.660786:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716416:0@lo:101: 00000100:00100000:2.0:1783349709.660817:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.660835:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.660863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716416 00000100:00100000:1.0:1783349709.660868:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716416 00000100:00100000:1.0:1783349709.660903:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783349709.660909:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f039fe3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+7:5765:x1869977666716416:12345-0@lo:101: 00010000:00010000:1.0:1783349709.660916:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349709.660925:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cd412cd/0x68b4a22a48475f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48475f63 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.660938:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cd412cd/0x68b4a22a48475f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.660946:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cd412cd/0x68b4a22a48475f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.660952:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cd412cd, rc 0) 00000100:00100000:1.0:1783349709.660983:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f039fe3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+8:5765:x1869977666716416:12345-0@lo:101: Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.660989:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349709.661009:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716416:0@lo:101: 00010000:00010000:2.0:1783349709.661018:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.661025:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.661053:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716544:0@lo:501: 00000100:00100000:2.0:1783349709.661069:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.661085:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.661118:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716544 00000100:00100000:3.0:1783349709.661123:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716544 00000100:00100000:3.0:1783349709.661147:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349709.661153:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2286bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+8:5765:x1869977666716544:12345-0@lo:501: 00000100:00100000:3.0:1783349709.661343:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2286bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5765:x1869977666716544:12345-0@lo:501: Request processed in 189us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.661359:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783349709.661377:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716544:0@lo:501: 00000100:00100000:2.0:1783349709.661399:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716672:0@lo:503: 00000100:00100000:2.0:1783349709.661424:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349709.661465:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716672 00000100:00100000:1.0:1783349709.661470:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716672 00000100:00100000:1.0:1783349709.661507:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783349709.661513:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081e2d170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5765:x1869977666716672:12345-0@lo:503: 00000100:00100000:2.0:1783349709.661634:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.661656:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081e2d170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5765:x1869977666716672:12345-0@lo:503: Request processed in 143us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.661663:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349709.661668:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666716672:0@lo:503: 00000100:00100000:2.0:1783349709.662488:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5809:1869977666716800:0@lo:502: 00000100:00100000:2.0:1783349709.662538:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.662570:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 0000000022c2d604 going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.662622:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716800 00000100:00100000:3.0:1783349709.662627:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716800 00000100:00100000:3.0:1783349709.662689:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349709.662695:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050fd1629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5809:x1869977666716800:12345-0@lo:502: 00000100:00100000:3.0:1783349709.662870:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050fd1629 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5809:x1869977666716800:12345-0@lo:502: Request processed in 177us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.662875:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349709.662950:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1310bf5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5809:1869977666716800:0@lo:502: 00000020:01000000:0.0:1783349709.662976:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349709.662986:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349709.662989:0:5809:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783349709.662993:0:5809:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783349709.662997:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349709.663009:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f5d9ba38) 00000020:00000080:0.0:1783349709.663025:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783349709.663032:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783349709.663092:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783349709.663099:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a48475f78 00000020:00000080:0.0:1783349709.663338:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783349709.663342:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349709.663345:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349709.663347:0:5809:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783349709.663349:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349709.663352:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349709.663354:0:5809:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783349709.663357:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349709.663363:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000093f974a8) 00000020:00000080:0.0:1783349709.663372:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783349709.663375:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783349709.663377:0:5809:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783349709.663379:0:5809:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783349709.663389:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783349709.663436:0:5809:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f6768dd3 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783349709.663452:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004f503201) 00000020:00000080:0.0:1783349709.663459:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783349709.663522:0:5809:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783349709.663528:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a48475f8d 00000020:00000080:0.0:1783349709.663626:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783349709.663632:0:5809:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783349709.663636:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x68b4a22a48475f94 00080000:01000000:0.0:1783349709.663640:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783349709.663643:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a48475f9b 00080000:10000000:0.0:1783349709.664016:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1783349709.664206:0:5809:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783349709.668121:0:5809:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783349709.721540:0:5809:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783349709.721944:0:5809:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1783349709.723726:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783349709.723962:0:5809:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783349709.744097:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c8ee5c29) 00000020:00000080:2.0:1783349709.744118:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783349709.744196:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783349709.744203:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a48475fa9 00000020:00000080:3.0:1783349709.744723:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783349709.746178:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783349709.768941:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349709.793039:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349709.826713:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349709.853780:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349709.887032:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1783349709.917398:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x68b4a22a48475fb0 00000020:00000080:2.0:1783349709.917766:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783349709.917778:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349709.917785:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349709.917788:0:5809:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783349709.917827:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349709.917834:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349709.917835:0:5809:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783349709.917839:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783349709.917889:0:5809:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783349709.917903:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349709.917907:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349709.917909:0:5809:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783349709.917911:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349709.917913:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349709.917913:0:5809:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783349709.917916:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783349709.917917:0:5809:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783349709.917961:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5809:1869977666716928:0@lo:502: 00000100:00100000:2.0:1783349709.918152:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.918262:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc6f9df2 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.918314:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666716928 00000100:00100000:1.0:1783349709.918321:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666716928 00000100:00100000:1.0:1783349709.918365:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783349709.918374:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ac8bb6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5809:x1869977666716928:12345-0@lo:502: 00000100:00100000:1.0:1783349709.918683:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ac8bb6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5809:x1869977666716928:12345-0@lo:502: Request processed in 310us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.918691:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783349709.918778:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5809:1869977666716928:0@lo:502: 00000020:01000000:2.0:1783349709.918818:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349709.918823:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349709.918828:0:5809:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783349709.918831:0:5809:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1783349709.919967:0:5765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1783349709.919983:0:5765:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783349709.919991:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.919999:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 00000000249d1811/0x68b4a22a48475f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349709.920006:0:5765:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320c6fcb000 from 1 10000000:01000000:3.0:1783349709.920009:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783349709.920050:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.920066:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.920072:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349709.920084:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717056:0@lo:101: 00000100:00100000:3.0:1783349709.920119:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349709.920145:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000336e89d4 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.920162:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717056 00000100:00100000:1.0:1783349709.920168:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717056 00000100:00100000:1.0:1783349709.920235:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783349709.920243:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0df8263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:5765:x1869977666717056:12345-0@lo:101: 00010000:00010000:1.0:1783349709.920253:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349709.920265:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48475fb7 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.920285:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.920294:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.920301:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f909d710, rc 0) 00000100:00100000:1.0:1783349709.920339:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0df8263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:5765:x1869977666717056:12345-0@lo:101: Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.920345:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349709.920435:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717056:0@lo:101: 00010000:00010000:3.0:1783349709.920446:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.920454:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349709.921049:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717184:0@lo:256: 00000100:00100000:3.0:1783349709.921082:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349709.921111:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000336e89d4 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.921179:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717184 00000100:00100000:1.0:1783349709.921184:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717184 00000100:00100000:1.0:1783349709.921210:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783349709.921216:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d31dff12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:5765:x1869977666717184:12345-0@lo:256: 20000000:01000000:1.0:1783349709.921228:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783349709.921234:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783349709.921397:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d31dff12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:5765:x1869977666717184:12345-0@lo:256: Request processed in 180us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.921404:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783349709.921450:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717184:0@lo:256: 10000000:01000000:3.0:1783349709.922005:0:5765:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783349709.922020:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.922028:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349709.922045:0:5765:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c6fcb000 from 1 10000000:01000000:3.0:1783349709.922048:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349709.922066:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.922072:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.922078:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349709.922088:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717312:0@lo:101: 00000100:00100000:3.0:1783349709.922112:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349709.922179:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000336e89d4 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.922215:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717312 00000100:00100000:1.0:1783349709.922219:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717312 00000100:00100000:1.0:1783349709.922251:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349709.922257:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009362c388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:5765:x1869977666717312:12345-0@lo:101: 00010000:00010000:1.0:1783349709.922265:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349709.922274:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48475fc5 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.922290:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.922297:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.922303:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019a97572, rc 0) 00000100:00100000:1.0:1783349709.922336:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009362c388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666717312:12345-0@lo:101: Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.922346:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783349709.922443:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717312:0@lo:101: 00010000:00010000:3.0:1783349709.922453:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.922460:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349709.922510:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717440:0@lo:501: 00000100:00100000:3.0:1783349709.922532:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349709.922583:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000336e89d4 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.922618:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717440 00000100:00100000:1.0:1783349709.922622:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717440 00000100:00100000:1.0:1783349709.922688:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349709.922695:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000162bac21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666717440:12345-0@lo:501: 00000100:00100000:1.0:1783349709.923353:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000162bac21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666717440:12345-0@lo:501: Request processed in 659us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.923361:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349709.923522:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bc9c40a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717440:0@lo:501: 00000100:00100000:2.0:1783349709.923561:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717568:0@lo:503: 00000100:00100000:2.0:1783349709.923599:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.923624:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bc6f9df2 going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.923646:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717568 00000100:00100000:3.0:1783349709.923651:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717568 00000100:00100000:3.0:1783349709.923681:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783349709.923687:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecde1cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666717568:12345-0@lo:503: 00000040:00080000:3.0:1783349709.923723:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349709.923763:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecde1cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666717568:12345-0@lo:503: Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.923769:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349709.923921:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717568:0@lo:503: 00000040:00080000:1.0:1783349709.926666:0:5813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783349709.926949:0:5765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783349709.926970:0:5765:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349709.926990:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.927001:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349709.927048:0:5765:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783349709.927051:0:5765:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9320c6fcb000 10000000:01000000:2.0:1783349709.927055:0:5765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9320c6fcb000 10000000:01000000:2.0:1783349709.927058:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349709.927063:0:5765:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320c6fcb000 from 1 10000000:01000000:2.0:1783349709.927066:0:5765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349709.927094:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.927101:0:5765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.927110:0:5765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.927146:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717696:0@lo:101: 00000100:00100000:2.0:1783349709.927202:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349709.927246:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717696 00000100:00100000:2.0:1783349709.927252:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.927254:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717696 00000100:00100000:1.0:1783349709.927300:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349709.927307:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed18a00e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666717696:12345-0@lo:101: 00010000:00010000:1.0:1783349709.927319:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349709.927330:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000adef1dfa/0x68b4a22a48475fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48475fd3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.927351:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adef1dfa/0x68b4a22a48475fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.927360:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000adef1dfa/0x68b4a22a48475fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349709.927367:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000adef1dfa, rc 0) 00000100:00100000:1.0:1783349709.927413:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed18a00e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5765:x1869977666717696:12345-0@lo:101: Request processed in 107us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.927420:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783349709.927615:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717696:0@lo:101: 00010000:00010000:2.0:1783349709.927629:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.927637:0:5765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.927678:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717824:0@lo:501: 00000100:00100000:2.0:1783349709.927703:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.927725:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:1.0:1783349709.929541:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717824 00000100:00100000:1.0:1783349709.929552:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717824 00000100:00100000:1.0:1783349709.929595:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349709.929602:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000366d8ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5765:x1869977666717824:12345-0@lo:501: 00000100:00100000:1.0:1783349709.929896:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000366d8ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5765:x1869977666717824:12345-0@lo:501: Request processed in 295us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.929911:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783349709.930071:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717824:0@lo:501: 00000100:00100000:2.0:1783349709.930113:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717952:0@lo:503: 00000100:00100000:2.0:1783349709.930153:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.930174:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8b3bb65 going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.930245:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666717952 00000100:00100000:3.0:1783349709.930249:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666717952 00000100:00100000:3.0:1783349709.930281:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783349709.930287:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000768a06fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5765:x1869977666717952:12345-0@lo:503: 00000100:00100000:3.0:1783349709.930764:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000768a06fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5765:x1869977666717952:12345-0@lo:503: Request processed in 477us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.930771:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783349709.931008:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666717952:0@lo:503: 00000100:00100000:1.0:1783349709.931350:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b2f18f85 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5814:1869977666718080:0@lo:502: 00000100:00100000:1.0:1783349709.931384:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349709.931410:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set 0000000056041abb going to sleep for 11 seconds 00000100:00100000:0.0:1783349709.931423:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718080 00000100:00100000:0.0:1783349709.931431:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718080 00000100:00100000:0.0:1783349709.931462:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783349709.931469:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edb6280b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5814:x1869977666718080:12345-0@lo:502: 00000100:00100000:0.0:1783349709.931669:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edb6280b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5814:x1869977666718080:12345-0@lo:502: Request processed in 201us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349709.931677:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349709.931697:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b2f18f85 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5814:1869977666718080:0@lo:502: 00000020:01000004:1.0:1783349709.931749:0:5814:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783349709.931770:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cd0d0bca) 00000020:00000080:1.0:1783349709.931788:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783349709.932107:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f6768dd3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783349709.932111:0:5814:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f6768dd3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783349709.932113:0:5814:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000f6768dd3 4 00010000:00080000:1.0:1783349709.932140:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b04bea5f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.136@tcp at head 00010000:00010000:1.0:1783349709.934512:0:5814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783349709.934680:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783349709.934710:0:5814:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783349709.934720:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x68b4a22a48475fe8 00000100:00080000:1.0:1783349709.934729:0:5814:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783349709.934734:0:5814:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b04bea5f using connection 192.168.204.136@tcp/0@lo 00000100:00100000:1.0:1783349709.934762:0:5814:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b2f18f85 x1869977666718208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783349709.934788:0:5814:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783349709.935220:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d2e7a72b pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5814:1869977666718336:0@lo:502: 00000100:00100000:1.0:1783349709.935290:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349709.935326:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718336 00000100:00100000:1.0:1783349709.935333:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set 0000000056041abb going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.935334:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718336 00000100:00100000:3.0:1783349709.935705:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349709.935714:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed9672b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5814:x1869977666718336:12345-0@lo:502: 00000100:00100000:3.0:1783349709.936007:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed9672b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5814:x1869977666718336:12345-0@lo:502: Request processed in 294us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349709.936012:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d2e7a72b pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:5814:1869977666718336:0@lo:502: 00000100:00100000:3.0:1783349709.936018:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000040:00080000:1.0:1783349709.936044:0:5814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783349709.936159:0:5765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783349709.936180:0:5765:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349709.936228:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.936237:0:5765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 0000000015c1c72b/0x68b4a22a48475fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783349709.936303:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783349709.936305:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349709.936307:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349709.936308:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349709.936310:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349709.936311:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349709.936313:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349709.936314:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349709.936316:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349709.936317:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349709.936319:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349709.936320:0:5765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349709.936323:0:5765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783349709.936326:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349709.936327:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349709.936329:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349709.936330:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349709.936331:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349709.936332:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349709.936333:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349709.936334:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349709.936335:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783349709.936336:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783349709.936336:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349709.936337:0:5765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349709.936352:0:5765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783349709.936360:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666718464:0@lo:253: 00000100:00100000:2.0:1783349709.936391:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.936411:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set 0000000090677547 going to sleep for 11 seconds 00000100:00100000:0.0:1783349709.936459:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b2f18f85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666718208:0@lo:38: 00000100:00100000:0.0:1783349709.936518:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349709.936557:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718464 00000100:00100000:0.0:1783349709.936562:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718464 00000100:00100000:1.0:1783349709.936598:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718208 00000100:00100000:0.0:1783349709.936598:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349709.936604:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718208 00000100:00100000:0.0:1783349709.936609:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a35d8fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5765:x1869977666718464:12345-0@lo:253: 00000100:00100000:1.0:1783349709.936629:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 20000000:01000000:0.0:1783349709.936633:0:5779:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1783349709.936636:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009657c660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666718208:12345-0@lo:38: 20000000:01000000:0.0:1783349709.936647:0:5779:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783349709.936680:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009657c660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666718208:12345-0@lo:38: Request processed in 44us (164us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783349709.936686:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349709.937429:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783349709.937435:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000b04bea5f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783349709.937439:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783349709.937442:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b2f18f85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666718208:0@lo:38: 20000000:01000000:0.0:1783349709.970917:0:5779:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783349709.970944:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783349709.970966:0:5800:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783349709.970972:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783349709.970991:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.971010:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.971030:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.971067:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349709.971079:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 12 pid: 5777 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.971094:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b2134a53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5800:1869977666718592:0@lo:104: 00000100:00100000:2.0:1783349709.971168:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349709.971225:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d37feedd going to sleep for 11 seconds 00000100:00100000:3.0:1783349709.971356:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718592 00000100:00100000:3.0:1783349709.971364:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718592 00000100:00100000:3.0:1783349709.971419:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349709.971428:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000514683d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5800:x1869977666718592:12345-0@lo:104: 00010000:00010000:3.0:1783349709.971440:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971509:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349709.971515:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000514683d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5800:x1869977666718592:12345-0@lo:104: Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.971528:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349709.971549:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b2134a53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5800:1869977666718592:0@lo:104: 00010000:00010000:3.0:1783349709.971551:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349709.971557:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971566:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cdb0fa3f already unused, calling callback (000000002974b466) 10000000:00010000:3.0:1783349709.971569:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971576:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349709.971576:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349709.971597:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349709.971602:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349709.971628:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971635:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349709.971661:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971667:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: 00000000cdb0fa3f/0x68b4a22a48475fb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fbe expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971683:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349709.971685:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349709.971686:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349709.971716:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349709.971737:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065a7b0b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666718720:0@lo:103: 00000100:00100000:0.0:1783349709.971766:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349709.971891:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718720 00000100:00100000:3.0:1783349709.971899:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718720 00010000:00010000:3.0:1783349709.971917:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 13 pid: 5777 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349709.971948:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349709.971956:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd646e06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:3291:x1869977666718720:12345-0@lo:103: 00010000:00010000:3.0:1783349709.971967:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349709.971972:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 13 pid: 5777 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971982:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 13 pid: 5777 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.971996:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f909d710/0x68b4a22a48475fbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48475fb7 expref: 13 pid: 5777 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972008:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972015:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783349709.972028:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001056860s 00010000:00010000:3.0:1783349709.972031:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972038:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972044:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972060:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972065:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000375f6cc4 already unused, calling callback (000000004dc8525f) 00010000:00010000:3.0:1783349709.972068:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972075:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972088:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972096:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349709.972123:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd646e06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3291:x1869977666718720:12345-0@lo:103: Request processed in 169us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349709.972130:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349709.972155:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065a7b0b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666718720:0@lo:103: 00010000:00010000:3.0:1783349709.972178:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972185:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349709.972190:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000375f6cc4/0x68b4a22a48475fef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349709.980120:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a35d8fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5765:x1869977666718464:12345-0@lo:253: Request processed in 43506us (43722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349709.980138:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349709.980298:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002aca5582 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:5765:1869977666718464:0@lo:253: 10000000:01000000:3.0:1783349709.980311:0:5765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783349709.980321:0:5765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349709.980323:0:5765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783349709.980325:0:5765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349709.980326:0:5765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349709.980327:0:5765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349709.980328:0:5765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349709.980329:0:5765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783349709.980331:0:5765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783349709.980332:0:5765:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349709.980334:0:5765:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349709.980335:0:5765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349709.980336:0:5765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783349709.980351:0:5765:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783349709.987311:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349709.987780:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349709.988031:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349709.988186:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349709.988379:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349709.988664:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349709.990368:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349709.990567:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349709.990742:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349709.990921:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349709.991124:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349709.991299:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1783349710.019303:0:5765:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783349710.046247:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783349710.046262:0:5819:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1783349710.046266:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783349710.046561:0:5820:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783349710.049469:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783349710.049630:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783349710.050138:0:5765:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783349710.050143:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783349710.050238:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349710.051360:0:5765:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783349710.051914:0:5765:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783349710.051941:0:5765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783349710.052219:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783349710.052417:0:5765:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1783349710.054347:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783349710.054575:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783349710.054769:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783349710.054968:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783349710.055356:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783349710.055522:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783349710.055741:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783349710.055981:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783349710.056194:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783349710.056391:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783349710.056690:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783349710.057029:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783349710.057293:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783349710.057440:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783349710.057617:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783349710.057785:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783349710.058172:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783349710.058360:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783349710.058601:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783349710.058850:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783349710.058988:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783349710.059167:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783349710.059477:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783349710.059841:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783349710.060104:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783349710.060507:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783349710.060716:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783349710.060920:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783349710.061201:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783349710.061401:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783349710.061523:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783349710.061626:0:5765:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783349710.061755:0:5765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1783349710.079315:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783349710.118202:0:5765:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783349710.118246:0:5765:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacb5c19d7988 00100000:10000000:0.0:1783349710.118255:0:5765:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783349710.120180:0:5765:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783349710.120195:0:5765:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783349710.120209:0:5765:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1783349710.120231:0:5765:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1783349710.149982:0:5820:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783349710.150134:0:5820:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783349710.150138:0:5820:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783349710.507564:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349711.529910:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349712.539640:0:6061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783349712.557084:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349713.578243:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349714.602050:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349715.305945:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783349715.305956:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783349715.305958:0:8:0:(import.c:65:import_set_state_nolock()) 00000000b04bea5f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349715.305971:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b04bea5f using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349715.305991:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000216c489 x1869977666718976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349715.306006:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000370d2455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666718848:0@lo:400: 00000100:00100000:2.0:1783349715.306052:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000216c489 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666718976:0@lo:38: 00000100:00100000:0.0:1783349715.306078:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349715.306098:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349715.306165:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718848 00000100:00100000:2.0:1783349715.306172:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718848 00000100:00100000:0.0:1783349715.306181:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666718976 00000100:00100000:0.0:1783349715.306198:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666718976 00000100:00100000:2.0:1783349715.306213:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783349715.306223:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa3ebe09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:3293:x1869977666718848:12345-0@lo:400: 00000100:00100000:0.0:1783349715.306231:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349715.306237:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b9979e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1869977666718976:12345-0@lo:38: 00010000:00080000:0.0:1783349715.306260:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000100:00100000:2.0:1783349715.306275:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa3ebe09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:3293:x1869977666718848:12345-0@lo:400: Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349715.306283:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:0.0:1783349715.306666:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x68b4a22a48475ff6 00000004:00100000:0.0:1783349715.306701:0:5786:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783349715.306804:0:5786:0:(import.c:65:import_set_state_nolock()) 0000000063fafc58 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349715.306841:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b9979e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1869977666718976:12345-0@lo:38: Request processed in 603us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349715.306848:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783349715.306889:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000216c489 x1869977666718976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783349715.306903:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783349715.306909:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783349715.306913:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783349715.306915:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000b04bea5f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783349715.306920:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000216c489 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666718976:0@lo:38: 00000100:00100000:0.0:1783349715.306941:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000370d2455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666718848:0@lo:400: 00010000:00010000:3.0:1783349715.626939:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349715.716625:0:6264:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd5cb8570 20000000:00000080:0.0:1783349715.716639:0:6264:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9320fb9fc400 uarg=0000000000000000 20000000:01000000:0.0:1783349715.716664:0:6264:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783349715.716669:0:6264:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783349715.716673:0:6264:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783349715.717208:0:6264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1783349715.717220:0:6264:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1783349715.723032:0:6264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349715.723242:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783349715.723283:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1783349715.723344:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1783349715.723362:0:6264:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783349715.723389:0:6264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349715.723408:0:6264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349715.723416:0:6264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349715.723451:0:6264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349715.723465:0:6264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 10 pid: 5777 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349715.723479:0:6264:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009b4d3157 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6264:1869977666719104:0@lo:104: 00000100:00100000:0.0:1783349715.723532:0:6264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349715.723583:0:6264:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f999f133 going to sleep for 11 seconds 00000100:00100000:2.0:1783349715.723605:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719104 00000100:00100000:2.0:1783349715.723614:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719104 00000100:00100000:2.0:1783349715.723670:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349715.723682:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd83f6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:6264:x1869977666719104:12345-0@lo:104: 00010000:00010000:2.0:1783349715.723694:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349715.723757:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349715.723763:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd83f6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:6264:x1869977666719104:12345-0@lo:104: Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349715.723770:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349715.723852:0:6264:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009b4d3157 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6264:1869977666719104:0@lo:104: 00010000:00010000:1.0:1783349715.723871:0:6264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.723921:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349715.723926:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.723931:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ddefece2 already unused, calling callback (000000002974b466) 10000000:00010000:3.0:1783349715.723933:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.723939:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349715.723945:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349715.723949:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783349715.723982:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.723992:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349715.724018:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724024:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: 00000000ddefece2/0x68b4a22a48475fc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fcc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724039:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349715.724040:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349715.724041:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349715.724076:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000065a7b0b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666719232:0@lo:103: 00000100:00100000:2.0:1783349715.724104:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349715.724202:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719232 00000100:00100000:3.0:1783349715.724207:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719232 00010000:00010000:3.0:1783349715.724223:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 11 pid: 5777 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349715.724248:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349715.724255:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023d6828d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:3294:x1869977666719232:12345-0@lo:103: 00010000:00010000:3.0:1783349715.724266:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349715.724271:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 11 pid: 5777 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724290:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 11 pid: 5777 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724302:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019a97572/0x68b4a22a48475fcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48475fc5 expref: 11 pid: 5777 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724317:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724453:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724464:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724469:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724472:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724476:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724478:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000132889e8 already unused, calling callback (000000004dc8525f) 00010000:00010000:3.0:1783349715.724480:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724484:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724497:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349715.724503:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349715.724530:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023d6828d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:3294:x1869977666719232:12345-0@lo:103: Request processed in 276us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349715.724537:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349715.724561:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000065a7b0b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666719232:0@lo:103: 00010000:00010000:1.0:1783349715.725066:0:6264:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349715.725076:0:6264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349715.725081:0:6264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000132889e8/0x68b4a22a48475ffd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349716.651261:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349717.676163:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349718.571157:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349718.571164:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320c6fcb000 from 3 10000000:01000000:0.0:1783349718.571169:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349718.571209:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.571220:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.571231:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.571264:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d45b3596 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719360:0@lo:101: 00000100:00100000:0.0:1783349718.571335:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.571395:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a2783081 going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.571464:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719360 00000100:00100000:2.0:1783349718.571470:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719360 00000100:00100000:2.0:1783349718.571521:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349718.571528:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083944bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:5781:x1869977666719360:12345-0@lo:101: 00010000:00010000:2.0:1783349718.571539:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349718.571548:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007baa35a2/0x68b4a22a4847600b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476004 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.571568:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007baa35a2/0x68b4a22a4847600b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476004 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.571576:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007baa35a2/0x68b4a22a4847600b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476004 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.571583:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007baa35a2, rc 0) 00000100:00100000:2.0:1783349718.571623:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083944bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5781:x1869977666719360:12345-0@lo:101: Request processed in 96us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.571629:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349718.571764:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d45b3596 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719360:0@lo:101: 00010000:00010000:1.0:1783349718.571777:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.571784:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349718.571857:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d2e7a72b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719488:0@lo:256: 00000100:00100000:1.0:1783349718.571971:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349718.571994:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set 000000001094c5ba going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.572133:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719488 00000100:00100000:2.0:1783349718.572137:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719488 00000100:00100000:2.0:1783349718.572166:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349718.572172:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002aead1d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5781:x1869977666719488:12345-0@lo:256: 20000000:01000000:2.0:1783349718.572185:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783349718.572199:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783349718.572201:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1783349718.573065:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002aead1d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5781:x1869977666719488:12345-0@lo:256: Request processed in 891us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.573074:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783349718.573214:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d2e7a72b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719488:0@lo:256: 10000000:01000000:0.0:1783349718.573273:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783349718.573281:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.573292:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: 00000000b5a818ef/0x68b4a22a48476004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349718.573302:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349718.573304:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c6fcb000 from 1 10000000:01000000:0.0:1783349718.573307:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349718.573340:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: 0000000061145fbe/0x68b4a22a48476012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.573347:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: 0000000061145fbe/0x68b4a22a48476012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.573355:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: 0000000061145fbe/0x68b4a22a48476012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.573369:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095028135 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719616:0@lo:101: 00000100:00100000:0.0:1783349718.573410:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.573449:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b66975a going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.573686:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719616 00000100:00100000:2.0:1783349718.573693:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719616 00000100:00100000:2.0:1783349718.573785:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349718.573814:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb335547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:5781:x1869977666719616:12345-0@lo:101: 00010000:00010000:2.0:1783349718.573825:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349718.573835:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ff2c6c8/0x68b4a22a48476019 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476012 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.574037:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ff2c6c8/0x68b4a22a48476019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476012 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.574049:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ff2c6c8/0x68b4a22a48476019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476012 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.574057:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ff2c6c8, rc 0) 00000100:00100000:2.0:1783349718.574140:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb335547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666719616:12345-0@lo:101: Request processed in 327us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.574147:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783349718.574209:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095028135 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719616:0@lo:101: 00010000:00010000:0.0:1783349718.574229:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: 0000000061145fbe/0x68b4a22a48476012 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.574237:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: 0000000061145fbe/0x68b4a22a48476012 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.574292:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095028135 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719744:0@lo:501: 00000100:00100000:0.0:1783349718.574335:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.574410:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b66975a going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.574627:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719744 00000100:00100000:2.0:1783349718.574632:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719744 00000100:00100000:2.0:1783349718.574671:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349718.574680:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a69b41bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666719744:12345-0@lo:501: 00000100:00100000:2.0:1783349718.575229:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a69b41bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666719744:12345-0@lo:501: Request processed in 552us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.575236:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783349718.575287:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095028135 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719744:0@lo:501: 00000100:00100000:0.0:1783349718.575316:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095028135 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719872:0@lo:503: 00000100:00100000:0.0:1783349718.575361:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.575422:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b66975a going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.575565:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666719872 00000100:00100000:2.0:1783349718.575570:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666719872 00000100:00100000:2.0:1783349718.575600:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349718.575606:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d87750b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666719872:12345-0@lo:503: 00000100:00100000:0.0:1783349718.575815:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095028135 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666719872:0@lo:503: 00000100:00100000:2.0:1783349718.576053:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d87750b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666719872:12345-0@lo:503: Request processed in 118us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.576071:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349718.576898:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000af70ec1d pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:6577:1869977666720000:0@lo:502: 00000100:00100000:2.0:1783349718.577018:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349718.577052:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set 00000000451563c9 going to sleep for 11 seconds 00000100:00100000:3.0:1783349718.577083:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720000 00000100:00100000:3.0:1783349718.577088:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720000 00000100:00100000:3.0:1783349718.577118:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783349718.577124:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d3ef8cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6577:x1869977666720000:12345-0@lo:502: 00000100:00100000:3.0:1783349718.577252:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d3ef8cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6577:x1869977666720000:12345-0@lo:502: Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.577260:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349718.577351:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000af70ec1d pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:6577:1869977666720000:0@lo:502: 00000020:01000000:0.0:1783349718.577430:0:6577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349718.577442:0:6577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349718.577444:0:6577:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783349718.577451:0:6577:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320c6fcb000 00000020:00000080:0.0:1783349718.577454:0:6577:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349718.577489:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:6577:1869977666720128:0@lo:502: 00000100:00100000:0.0:1783349718.577523:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.577547:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.577879:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720128 00000100:00100000:2.0:1783349718.577884:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720128 00000100:00100000:2.0:1783349718.577975:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349718.577984:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6577:x1869977666720128:12345-0@lo:502: 00000100:00100000:2.0:1783349718.578094:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6577:x1869977666720128:12345-0@lo:502: Request processed in 111us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.578101:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349718.578184:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:6577:1869977666720128:0@lo:502: 00000020:01000000:0.0:1783349718.578207:0:6577:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349718.578212:0:6577:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349718.578219:0:6577:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783349718.578224:0:6577:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783349718.581643:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783349718.581733:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349718.581746:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.581759:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.698145:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783349718.761576:0:6575:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783349718.761580:0:6575:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783349718.761712:0:6575:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9320f70f3800 00000020:01000004:2.0:1783349718.761727:0:6575:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783349718.761737:0:6575:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783349718.761749:0:6575:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9320c726cd40) 00000020:00000080:2.0:1783349718.761762:0:6575:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783349718.777967:0:6575:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1783349718.778336:0:6575:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783349718.798961:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783349718.804306:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783349718.804355:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783349718.804410:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783349718.804441:0:6575:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783349718.804767:0:6575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783349718.804776:0:6575:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783349718.804784:0:6575:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x68b4a22a48476027 00000020:01000004:2.0:1783349718.804848:0:6575:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783349718.804868:0:6575:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.136@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783349718.804871:0:6575:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783349718.804877:0:6575:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783349718.804881:0:6575:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783349718.804891:0:6575:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9320c72699c0) 00000020:00000080:2.0:1783349718.804900:0:6575:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783349718.805959:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349718.806065:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349718.806083:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783349718.806650:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783349718.806656:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783349718.807147:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783349718.807153:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783349718.809398:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349718.809587:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783349718.809594:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1783349718.810346:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1783349718.810353:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783349718.827145:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349718.827369:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783349718.827375:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783349718.829189:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783349718.829200:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783349718.830832:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783349718.830844:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783349718.836104:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349718.836276:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783349718.836282:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783349718.837141:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783349718.837148:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783349718.889241:0:6575:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349718.889444:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783349718.889451:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783349718.890764:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783349718.890773:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783349718.891360:0:6575:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783349718.891383:0:6575:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783349718.891388:0:6575:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783349718.915160:0:6575:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783349718.915208:0:6575:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.136@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783349718.915212:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783349718.915214:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783349718.915215:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349718.915216:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349718.915218:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349718.915219:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349718.915221:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349718.915223:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349718.915224:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349718.915226:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349718.915227:0:6575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349718.915231:0:6575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783349718.915233:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349718.915234:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783349718.915236:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349718.915237:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349718.915243:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349718.915244:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349718.915245:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349718.915246:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783349718.915247:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783349718.915248:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349718.915249:0:6575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349718.915274:0:6575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783349718.915292:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666720256:0@lo:253: 00000100:00100000:3.0:1783349718.915389:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349718.915453:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d6ac3480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.915632:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720256 00000100:00100000:2.0:1783349718.915640:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720256 00000100:00100000:2.0:1783349718.915688:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349718.915697:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666720256:12345-0@lo:253: 20000000:01000000:2.0:1783349718.915735:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783349718.915739:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783349718.915754:0:5779:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783349718.915757:0:5779:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1783349718.917211:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349718.917457:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1783349718.917472:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1783349718.917509:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1783349718.917517:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1783349718.917548:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1783349718.917616:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1783349718.917903:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1783349718.917921:0:5779:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.136@tcp 20000000:01000000:2.0:1783349718.917923:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.136@tcp (null) (null) (null) 00000040:00080000:2.0:1783349718.917957:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1783349718.917965:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783349718.918021:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1783349718.918030:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.136@tcp (null) (null) 00000040:00080000:2.0:1783349718.918062:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1783349718.918070:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783349718.918098:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1783349718.918157:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1783349718.919597:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1783349718.919615:0:5779:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.136@tcp 20000000:01000000:2.0:1783349718.919617:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.136@tcp (null) (null) (null) 00000040:00080000:2.0:1783349718.919647:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1783349718.919655:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783349718.919683:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1783349718.919690:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.136@tcp (null) (null) 00000040:00080000:2.0:1783349718.919735:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1783349718.919745:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783349718.919774:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1783349718.920263:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1783349718.920280:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783349718.920282:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783349718.920286:0:5779:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783349718.920297:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783349718.920300:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783349718.920340:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783349718.920342:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783349718.921403:0:6591:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783349718.921658:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1783349718.921703:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1783349718.922168:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1783349718.922197:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783349718.922199:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783349718.922621:0:6592:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783349718.922665:0:6592:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783349718.922710:0:6592:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783349718.923461:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783349718.923512:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783349718.923574:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1783349718.923586:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783349718.923588:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783349718.924219:0:6593:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1783349718.924268:0:6593:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1783349718.924385:0:6593:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783349718.925132:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1783349718.925179:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1783349718.925212:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1783349718.925228:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1783349718.925231:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1783349718.925239:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783349718.925273:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.925292:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.925300:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.925328:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.925336:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.925643:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.925658:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 12 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349718.925671:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666720384:0@lo:104: 00000100:00100000:3.0:1783349718.925736:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349718.925779:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720384 00000100:00100000:2.0:1783349718.925787:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720384 00000100:00100000:2.0:1783349718.925951:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349718.925961:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666720384:12345-0@lo:104: 00010000:00010000:2.0:1783349718.925974:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926031:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349718.926039:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666720384:12345-0@lo:104: Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.926046:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783349718.926056:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349718.926063:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.926066:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.926076:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.926087:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102050600 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349718.926091:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349718.926094:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666720512:0@lo:104: 00010000:00010000:1.0:1783349718.926102:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349718.926108:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349718.926112:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783349718.926127:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349718.926140:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.926148:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783349718.926154:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720512 00000100:00100000:2.0:1783349718.926158:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720512 00010000:00010000:1.0:1783349718.926167:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.926175:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.926185:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 12 pid: 5777 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349718.926189:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1783349718.926199:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102050600/0x68b4a22a48475fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475fda expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349718.926200:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666720512:12345-0@lo:104: 00000100:00100000:3.0:1783349718.926206:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666720768:0@lo:104: 00010000:00010000:2.0:1783349718.926209:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.926214:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349718.926216:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349718.926218:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349718.926233:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666720640:0@lo:103: 00000100:00100000:3.0:1783349718.926262:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349718.926271:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349718.926278:0:5779:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d6ac3f00 going to sleep for 11 seconds 00010000:00010000:2.0:1783349718.926294:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349718.926299:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666720384:0@lo:104: 00000100:00100000:2.0:1783349718.926303:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666720512:12345-0@lo:104: Request processed in 103us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.926313:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666720512:0@lo:104: 00000100:00100000:2.0:1783349718.926314:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349718.926345:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720768 00000100:00100000:2.0:1783349718.926355:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720768 00000100:00100000:2.0:1783349718.926384:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349718.926390:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666720768:12345-0@lo:104: 00010000:00010000:2.0:1783349718.926397:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926433:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783349718.926438:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666720768:12345-0@lo:104: Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.926445:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783349718.926462:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349718.926467:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926474:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349718.926476:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926482:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349718.926488:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349718.926492:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349718.926519:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926526:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349718.926536:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926549:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48475f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475f6a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926559:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349718.926562:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926568:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102050c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349718.926571:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926577:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349718.926582:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349718.926587:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349718.926599:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926604:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349718.926616:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926623:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102050c00/0x68b4a22a48475f47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48475f4e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926633:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349718.926640:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349718.926641:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349718.926651:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666721024:0@lo:103: 00000100:00100000:2.0:1783349718.926675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349718.926707:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720640 00000100:00100000:2.0:1783349718.926710:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720640 00010000:00010000:2.0:1783349718.926726:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 13 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349718.926744:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721024 00000100:00100000:2.0:1783349718.926746:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721024 00010000:00010000:2.0:1783349718.926755:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 14 pid: 5777 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349718.926765:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349718.926770:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3291:x1869977666720640:12345-0@lo:103: 00010000:00010000:2.0:1783349718.926779:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349718.926783:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 14 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926813:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 14 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926826:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d7535c00/0x68b4a22a48475fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48475fd3 expref: 14 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926837:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349718.926858:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:3291:x1869977666720640:12345-0@lo:103: Request processed in 87us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.926864:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349718.926882:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349718.926888:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3293:x1869977666721024:12345-0@lo:103: 00010000:00010000:2.0:1783349718.926895:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349718.926899:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 12 pid: 5777 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926907:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 12 pid: 5777 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.926917:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349718.926942:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3293:x1869977666721024:12345-0@lo:103: Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.926948:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349718.926966:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666720896:0@lo:103: 00000100:00100000:2.0:1783349718.926989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349718.927034:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666721024:0@lo:103: 00000100:00100000:2.0:1783349718.927054:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666720640:0@lo:103: 00010000:00010000:2.0:1783349718.927063:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349718.927143:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666720896 00000100:00100000:1.0:1783349718.927148:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666720896 00010000:00010000:1.0:1783349718.927163:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349718.927190:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783349718.927197:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3292:x1869977666720896:12345-0@lo:103: 00010000:00010000:1.0:1783349718.927204:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349718.927208:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927215:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927225:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d7535600/0x68b4a22a48475f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48475f63 expref: 12 pid: 5779 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927235:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927253:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927267:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927274:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.927281:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030400/0x68b4a22a48475f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48475f47 expref: 11 pid: 5777 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349718.927292:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666720768:0@lo:104: 00010000:00010000:1.0:1783349718.927932:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927939:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.927942:0:5779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927944:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d673d200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349718.927951:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927961:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927970:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.927980:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349718.928018:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:3292:x1869977666720896:12345-0@lo:103: Request processed in 821us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349718.928026:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349718.928045:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666720896:0@lo:103: 00010000:00010000:2.0:1783349718.928100:0:5779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.928109:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.928117:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673d200/0x68b4a22a48476035 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783349718.928131:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783349718.974607:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:6575:x1869977666720256:12345-0@lo:253: Request processed in 58903us (59211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.974618:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349718.974707:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666720256:0@lo:253: 10000000:01000000:3.0:1783349718.974719:0:6575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783349718.974721:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349718.974722:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783349718.974723:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349718.974724:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1783349718.974725:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349718.974726:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349718.974727:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349718.974728:0:6575:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783349718.974729:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349718.974729:0:6575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783349718.974745:0:6575:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9320f70f3800 from lustre-OST0000 10000000:01000000:3.0:1783349718.974762:0:6575:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783349718.974764:0:6575:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783349718.974769:0:6575:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9320c75e8000 local copy 10000000:01000000:3.0:1783349718.974772:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783349718.974921:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.974938:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.974947:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349718.974965:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721152:0@lo:101: 00000100:00100000:3.0:1783349718.974996:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349718.975061:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.975099:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721152 00000100:00100000:2.0:1783349718.975105:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721152 00000100:00100000:2.0:1783349718.975174:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349718.975182:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+9:6575:x1869977666721152:12345-0@lo:101: 00010000:00010000:2.0:1783349718.975195:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349718.975207:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102050c00/0x68b4a22a48476043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847603c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.975228:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102050c00/0x68b4a22a48476043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847603c expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.975238:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102050c00/0x68b4a22a48476043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847603c expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349718.975247:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050c00, rc 0) 00000100:00100000:2.0:1783349718.975296:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:6575:x1869977666721152:12345-0@lo:101: Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.975303:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349718.975364:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721152:0@lo:101: 00010000:00010000:0.0:1783349718.975375:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.975383:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.975472:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721280:0@lo:501: 00000100:00100000:0.0:1783349718.975498:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.975665:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f71a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349718.975734:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721280 00000100:00100000:3.0:1783349718.975738:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721280 00000100:00100000:3.0:1783349718.975758:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349718.975765:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:6575:x1869977666721280:12345-0@lo:501: 00000100:00100000:3.0:1783349718.976118:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:6575:x1869977666721280:12345-0@lo:501: Request processed in 353us (618us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783349718.976126:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783349718.976195:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721280:0@lo:501: 10000000:01000000:0.0:1783349718.976209:0:6575:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783349718.976247:0:6575:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783349718.976253:0:6575:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.976273:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.976280:0:6575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.976303:0:6575:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783349718.976334:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9320f70f3800 10000000:01000000:0.0:1783349718.976339:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783349718.976343:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9320c75e8000 10000000:01000000:0.0:1783349718.976346:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783349718.976349:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9320c75e8000 from 1 10000000:01000000:0.0:1783349718.976352:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783349718.976368:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.976375:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.976382:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.976393:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721408:0@lo:101: 00000100:00100000:0.0:1783349718.976418:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.976435:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783349718.976528:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349718.976534:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976541:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d673dc00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349718.976545:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976552:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349718.976560:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349718.976571:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349718.976587:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976594:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349718.976623:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976631:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d673dc00/0x68b4a22a4847603c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x68b4a22a48476043 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976645:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349718.976646:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349718.976648:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349718.976656:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721408 00000100:00100000:3.0:1783349718.976660:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721408 00000100:00100000:3.0:1783349718.976680:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349718.976687:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:6575:x1869977666721408:12345-0@lo:101: 00010000:00010000:3.0:1783349718.976695:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349718.976704:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d673c800/0x68b4a22a48476051 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847604a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976720:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d673c800/0x68b4a22a48476051 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847604a expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976729:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d673c800/0x68b4a22a48476051 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847604a expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.976736:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d673c800, rc 0) 00000100:00100000:3.0:1783349718.976772:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666721408:12345-0@lo:101: Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.976778:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349718.976887:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666721536:0@lo:103: 00000100:00100000:0.0:1783349718.976921:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.976973:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721408:0@lo:101: 00010000:00010000:0.0:1783349718.976984:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.976992:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349718.977006:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783349718.977017:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.977024:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349718.977030:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783349718.977033:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783349718.977037:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783349718.977039:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783349718.977052:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.977057:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.977063:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.977072:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721664:0@lo:101: 00000100:00100000:0.0:1783349718.977104:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.977116:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349718.977218:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721536 00000100:00100000:3.0:1783349718.977222:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721536 00000100:00100000:3.0:1783349718.977268:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349718.977276:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:3294:x1869977666721536:12345-0@lo:103: 00010000:00010000:3.0:1783349718.977284:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349718.977295:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050c00/0x68b4a22a48476043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a4847603c expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.977305:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349718.977347:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:3294:x1869977666721536:12345-0@lo:103: Request processed in 72us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.977354:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349718.977377:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666721536:0@lo:103: 00000100:00100000:3.0:1783349718.977392:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721664 00000100:00100000:3.0:1783349718.977395:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721664 00000100:00100000:3.0:1783349718.977409:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783349718.977414:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+10:6575:x1869977666721664:12345-0@lo:101: 00010000:00010000:3.0:1783349718.977420:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349718.977428:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476058 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.977441:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476058 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.977448:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476058 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.977461:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d673d200, rc 0) 00000100:00100000:3.0:1783349718.977485:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666721664:12345-0@lo:101: Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.977490:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349718.977655:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721664:0@lo:101: 00010000:00010000:0.0:1783349718.977665:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349718.977672:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349718.977734:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721792:0@lo:501: 00000100:00100000:0.0:1783349718.977751:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.977769:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349718.977816:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721792 00000100:00100000:3.0:1783349718.977819:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721792 00000100:00100000:3.0:1783349718.977839:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783349718.977843:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666721792:12345-0@lo:501: 00000100:00100000:3.0:1783349718.978105:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666721792:12345-0@lo:501: Request processed in 260us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.978112:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783349718.978187:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721792:0@lo:501: 00000100:00100000:0.0:1783349718.978213:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721920:0@lo:503: 00000100:00100000:0.0:1783349718.978250:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349718.978346:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666721920 00000100:00100000:2.0:1783349718.978351:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666721920 00000100:00100000:2.0:1783349718.978380:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783349718.978387:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666721920:12345-0@lo:503: 00000100:00100000:0.0:1783349718.978555:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349718.978710:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666721920:12345-0@lo:503: Request processed in 323us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349718.978716:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783349718.978775:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666721920:0@lo:503: 00000040:00080000:0.0:1783349718.979340:0:6575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349718.979416:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722048:0@lo:502: 00000100:00100000:0.0:1783349718.979455:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.979512:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349718.979549:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722048 00000100:00100000:3.0:1783349718.979554:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722048 00000100:00100000:3.0:1783349718.979624:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783349718.979631:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666722048:12345-0@lo:502: 00000100:00100000:3.0:1783349718.979785:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666722048:12345-0@lo:502: Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349718.979817:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783349718.979900:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722048:0@lo:502: 00000040:00080000:0.0:1783349718.980135:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783349718.980195:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783349718.980232:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783349718.980422:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783349718.980470:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783349718.980500:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783349718.980522:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722176:0@lo:502: 00000100:00100000:0.0:1783349718.980561:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349718.980687:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349718.980777:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722176 00000100:00100000:1.0:1783349718.980788:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722176 00000100:00100000:1.0:1783349718.980838:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349718.980845:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666722176:12345-0@lo:502: 00000100:00100000:1.0:1783349718.980997:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666722176:12345-0@lo:502: Request processed in 151us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349718.981003:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783349718.981193:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722176:0@lo:502: 00000040:00080000:0.0:1783349718.981339:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783349718.981350:0:6575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1783349718.981776:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783349718.981783:0:6597:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783349718.981823:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349718.981826:0:6597:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783349718.981833:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349718.981847:0:6597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9320f7d919c0) 00000020:00000080:0.0:1783349718.981933:0:6597:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783349718.981942:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783349718.982008:0:6597:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320f70f3800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783349718.982015:0:6597:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783349718.982020:0:6597:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x68b4a22a4847606d 00010000:00010000:0.0:1783349718.986929:0:6597:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1783349718.987208:0:6597:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1783349718.989672:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783349718.989939:0:6597:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1783349718.996222:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1783349718.996766:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783349718.998182:0:6597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783349718.998192:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349718.998198:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349718.998200:0:6597:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783349718.998203:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349718.998207:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349718.998213:0:6597:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783349718.998217:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783349718.998218:0:6597:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783349718.998957:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349718.998963:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349718.998965:0:6597:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783349718.998969:0:6597:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783349718.999101:0:6575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1783349718.999127:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783349718.999149:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.999161:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349718.999169:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f70f3800 from 1 10000000:01000000:1.0:1783349718.999172:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349718.999205:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.999212:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349718.999222:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349718.999244:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722304:0@lo:101: 00000100:00100000:1.0:1783349718.999380:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349718.999431:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c8f8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349718.999774:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722304 00000100:00100000:3.0:1783349718.999783:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722304 00000100:00100000:3.0:1783349718.999862:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349718.999872:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:6575:x1869977666722304:12345-0@lo:101: 00010000:00010000:3.0:1783349718.999887:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349718.999900:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476074 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.999939:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476074 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.999951:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476074 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349718.999960:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d673dc00, rc 0) 00000100:00100000:3.0:1783349719.000545:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722304:12345-0@lo:101: Request processed in 672us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.000553:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783349719.000616:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722304:0@lo:101: 00010000:00010000:0.0:1783349719.000632:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349719.000641:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349719.000738:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722432:0@lo:501: 00000100:00100000:0.0:1783349719.000768:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349719.000825:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722432 00000100:00100000:0.0:1783349719.000827:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f71000 going to sleep for 10 seconds 00000100:00100000:3.0:1783349719.000832:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722432 00000100:00100000:3.0:1783349719.000865:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349719.000873:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722432:12345-0@lo:501: 00000100:00100000:3.0:1783349719.001256:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722432:12345-0@lo:501: Request processed in 382us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.001263:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783349719.001295:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722432:0@lo:501: 00000100:00100000:3.0:1783349719.001338:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722560:0@lo:503: 00000100:00100000:3.0:1783349719.001525:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349719.001597:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc4648cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349719.001643:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722560 00000100:00100000:2.0:1783349719.001717:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722560 00000100:00100000:2.0:1783349719.001757:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349719.001766:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722560:12345-0@lo:503: 00000100:00100000:2.0:1783349719.002090:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722560:12345-0@lo:503: Request processed in 320us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349719.002098:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783349719.002120:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722560:0@lo:503: 00000040:00080000:0.0:1783349719.002662:0:6575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349719.002719:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722688:0@lo:502: 00000100:00100000:0.0:1783349719.002757:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349719.002807:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f71540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.002874:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722688 00000100:00100000:3.0:1783349719.002880:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722688 00000100:00100000:3.0:1783349719.002919:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783349719.002926:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722688:12345-0@lo:502: 00000100:00100000:3.0:1783349719.003143:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722688:12345-0@lo:502: Request processed in 216us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.003158:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349719.003942:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722688:0@lo:502: 00000040:00080000:2.0:1783349719.004503:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783349719.004554:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783349719.004585:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722816:0@lo:502: 00000100:00100000:2.0:1783349719.004635:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349719.004863:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87ddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.004917:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722816 00000100:00100000:3.0:1783349719.004924:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722816 00000100:00100000:3.0:1783349719.005170:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783349719.005181:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722816:12345-0@lo:502: 00000100:00100000:3.0:1783349719.006754:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722816:12345-0@lo:502: Request processed in 1562us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.006765:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783349719.007102:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722816:0@lo:502: 00000040:00080000:2.0:1783349719.007238:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783349719.007252:0:6575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783349719.008442:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349719.008452:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349719.008455:0:6601:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783349719.008462:0:6601:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320f70f3800 00000020:00000080:2.0:1783349719.008465:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783349719.008487:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349719.008490:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349719.008492:0:6601:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783349719.008495:0:6601:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783349719.008635:0:6575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783349719.008653:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349719.008715:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349719.008727:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349719.008773:0:6575:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783349719.008775:0:6575:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9320f70f3800 10000000:01000000:0.0:1783349719.008777:0:6575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9320f70f3800 10000000:01000000:0.0:1783349719.008780:0:6575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783349719.008784:0:6575:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320f70f3800 from 1 10000000:01000000:0.0:1783349719.008786:0:6575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783349719.008837:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349719.008845:0:6575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349719.008855:0:6575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349719.008877:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722944:0@lo:101: 00000100:00100000:0.0:1783349719.008929:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349719.008972:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f71300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.009071:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666722944 00000100:00100000:3.0:1783349719.009080:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666722944 00000100:00100000:3.0:1783349719.009128:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783349719.009138:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666722944:12345-0@lo:101: 00010000:00010000:3.0:1783349719.009150:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349719.009164:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476082 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.009188:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476082 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.009201:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476082 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.009210:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d673d000, rc 0) 00000100:00100000:3.0:1783349719.009272:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666722944:12345-0@lo:101: Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.009280:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783349719.009359:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666722944:0@lo:101: 00010000:00010000:0.0:1783349719.009373:0:6575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349719.009381:0:6575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349719.009457:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723072:0@lo:501: 00000100:00100000:0.0:1783349719.009484:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349719.009511:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f71300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.009600:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723072 00000100:00100000:3.0:1783349719.009605:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723072 00000100:00100000:3.0:1783349719.009756:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783349719.009764:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723072:12345-0@lo:501: 00000100:00100000:3.0:1783349719.010011:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723072:12345-0@lo:501: Request processed in 247us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.010018:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783349719.010221:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723072:0@lo:501: 00000100:00100000:2.0:1783349719.010248:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723200:0@lo:503: 00000100:00100000:2.0:1783349719.010285:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349719.010334:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.010355:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723200 00000100:00100000:3.0:1783349719.010360:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723200 00000100:00100000:3.0:1783349719.010535:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783349719.010544:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723200:12345-0@lo:503: 00000100:00100000:3.0:1783349719.010691:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723200:12345-0@lo:503: Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.010698:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783349719.010725:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723200:0@lo:503: 00000040:00080000:2.0:1783349719.011405:0:6575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783349719.011456:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723328:0@lo:502: 00000100:00100000:2.0:1783349719.011678:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349719.011718:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.012115:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723328 00000100:00100000:3.0:1783349719.012121:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723328 00000100:00100000:3.0:1783349719.012160:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783349719.012168:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723328:12345-0@lo:502: 00000100:00100000:3.0:1783349719.012396:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723328:12345-0@lo:502: Request processed in 228us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.012404:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783349719.012425:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723328:0@lo:502: 00000040:00080000:2.0:1783349719.012732:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783349719.012779:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783349719.012833:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783349719.012885:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783349719.012921:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783349719.012968:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783349719.013002:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783349719.013035:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783349719.013079:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783349719.013114:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783349719.013145:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783349719.013188:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783349719.013290:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783349719.013340:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783349719.013392:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783349719.013428:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783349719.013458:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783349719.013515:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783349719.013553:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783349719.013586:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783349719.013656:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783349719.013698:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783349719.013748:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783349719.018989:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783349719.019107:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783349719.019148:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783349719.019608:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783349719.019651:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1783349719.019700:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723456:0@lo:502: 00000100:00100000:2.0:1783349719.019782:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349719.019852:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723456 00000100:00100000:0.0:1783349719.019860:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723456 00000100:00100000:2.0:1783349719.019862:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1783349719.019917:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783349719.019927:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723456:12345-0@lo:502: 00000100:00100000:0.0:1783349719.020162:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723456:12345-0@lo:502: Request processed in 236us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349719.020171:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783349719.020300:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723456:0@lo:502: 00000040:00080000:2.0:1783349719.020446:0:6575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783349719.020456:0:6575:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1783349719.021097:0:6602:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783349719.021110:0:6602:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9320c75eb380) 00000020:00000080:3.0:1783349719.021128:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1783349719.021353:0:6602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320f70f3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783349719.021357:0:6602:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320f70f3800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783349719.021359:0:6602:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320f70f3800 3 00010000:00080000:3.0:1783349719.021383:0:6602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931fc4706800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.136@tcp at head 00010000:00010000:3.0:1783349719.025177:0:6602:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783349719.025272:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783349719.025324:0:6602:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783349719.025337:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x68b4a22a48476097 00000100:00080000:3.0:1783349719.025347:0:6602:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349719.025353:0:6602:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff931fc4706800 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:3.0:1783349719.025388:0:6602:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320f7ae3800 x1869977666723584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783349719.025405:0:6602:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1783349719.025618:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1783349719.025880:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349719.025894:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666723712:0@lo:400: 00000100:00100000:2.0:1783349719.025957:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349719.026025:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1869977666723584:0@lo:38: 00000020:01000000:0.0:1783349719.026073:0:6575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1783349719.026099:0:6575:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1783349719.027785:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723712 00000100:00100000:1.0:1783349719.027807:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723712 00000100:00100000:2.0:1783349719.027848:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349719.027855:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723584 00000100:00100000:1.0:1783349719.027858:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723584 00000100:00100000:1.0:1783349719.027872:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349719.027881:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666723712:12345-0@lo:400: 00000100:00100000:2.0:1783349719.027883:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783349719.027889:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783349719.027944:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666723712:12345-0@lo:400: Request processed in 64us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349719.027952:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349719.027968:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349719.027972:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1869977666723584:12345-0@lo:38: 00010000:00080000:1.0:1783349719.027991:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:1.0:1783349719.028020:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x68b4a22a4847609e 00000004:00100000:1.0:1783349719.028033:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783349719.028061:0:5785:0:(import.c:65:import_set_state_nolock()) ffff9320ff37f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349719.028100:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1869977666723584:12345-0@lo:38: Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349719.028108:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783349719.028153:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9320f7ae3800 x1869977666723584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349719.028164:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783349719.028171:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783349719.028177:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783349719.028182:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783349719.028183:0:3290:0:(import.c:65:import_set_state_nolock()) ffff931fc4706800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783349719.028187:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1869977666723584:0@lo:38: 00010000:00080000:1.0:1783349719.028228:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9320c7258700 x1869977666723712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349719.028254:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666723712:0@lo:400: 00010000:00010000:0.0:1783349719.028296:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349719.028307:0:6575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783349719.028571:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783349719.028573:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783349719.028574:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349719.028575:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349719.028577:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349719.028578:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349719.028579:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349719.028581:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349719.028582:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349719.028584:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349719.028585:0:6575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783349719.028588:0:6575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1783349719.028591:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783349719.028592:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783349719.028593:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349719.028594:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349719.028599:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349719.028599:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349719.028600:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349719.028601:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349719.028602:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349719.028603:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349719.028604:0:6575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783349719.028620:0:6575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783349719.028631:0:6575:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723840:0@lo:253: 00000100:00100000:0.0:1783349719.028738:0:6575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349719.028767:0:6575:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349719.028888:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723840 00000100:00100000:1.0:1783349719.028894:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723840 00000100:00100000:1.0:1783349719.028930:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783349719.028938:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:6575:x1869977666723840:12345-0@lo:253: 20000000:01000000:1.0:1783349719.028955:0:5777:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783349719.028967:0:5777:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783349719.055733:0:5777:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783349719.055788:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783349719.058743:0:5800:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783349719.058752:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783349719.058772:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.058804:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476004 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.058814:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.058854:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476004 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.058867:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476004 expref: 13 pid: 5779 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349719.058881:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5800:1869977666723968:0@lo:104: 00000100:00100000:3.0:1783349719.058944:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349719.058995:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349719.059018:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666723968 00000100:00100000:3.0:1783349719.059025:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666723968 00000100:00100000:3.0:1783349719.059083:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349719.059091:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5800:x1869977666723968:12345-0@lo:104: 00010000:00010000:3.0:1783349719.059103:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059152:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349719.059157:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5800:x1869977666723968:12345-0@lo:104: Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.059165:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349719.059203:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5800:1869977666723968:0@lo:104: 00010000:00010000:3.0:1783349719.059220:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059237:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349719.059242:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059247:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349719.059251:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059271:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349719.059279:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349719.059285:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349719.059311:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059334:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349719.059352:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059358:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847600b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059375:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349719.059376:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349719.059378:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349719.059394:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666724096:0@lo:103: 00000100:00100000:3.0:1783349719.059427:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349719.059460:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724096 00000100:00100000:3.0:1783349719.059464:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724096 00010000:00010000:3.0:1783349719.059480:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476004 expref: 14 pid: 5779 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349719.059499:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349719.059505:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3292:x1869977666724096:12345-0@lo:103: 00010000:00010000:3.0:1783349719.059514:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349719.059519:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476004 expref: 14 pid: 5779 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059528:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476004 expref: 14 pid: 5779 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059540:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102051400/0x68b4a22a4847600b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476004 expref: 14 pid: 5779 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059562:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059569:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783349719.059581:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001056860s 00010000:00010000:3.0:1783349719.059586:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059591:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059597:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059603:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059608:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d673c200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349719.059611:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059618:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059630:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059638:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349719.059671:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:3292:x1869977666724096:12345-0@lo:103: Request processed in 166us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349719.059678:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783349719.059720:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059728:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349719.059735:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673c200/0x68b4a22a484760a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349719.059759:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666724096:0@lo:103: 00000100:00100000:2.0:1783349719.062275:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:6575:x1869977666723840:12345-0@lo:253: Request processed in 33329us (33527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349719.062288:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783349719.062448:0:6575:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:6575:1869977666723840:0@lo:253: 10000000:01000000:0.0:1783349719.062462:0:6575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783349719.062464:0:6575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783349719.062466:0:6575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783349719.062467:0:6575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349719.062469:0:6575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349719.062470:0:6575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349719.062471:0:6575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349719.062472:0:6575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349719.062474:0:6575:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349719.062475:0:6575:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349719.062477:0:6575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349719.062478:0:6575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783349719.062490:0:6575:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783349719.067772:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349719.068021:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349719.068245:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349719.068596:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349719.068867:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349719.069106:0:6575:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783349719.070609:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783349719.221747:0:6575:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783349719.221755:0:6575:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783349719.221787:0:6575:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783349719.221861:0:6575:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783349719.221880:0:6575:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783349719.221907:0:6575:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1783349719.721937:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349720.748046:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349721.772496:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349722.794893:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349723.192496:0:6946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783349723.818002:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349724.522021:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c725b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666724224:0@lo:400: 00000100:00100000:0.0:1783349724.522067:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666724480:0@lo:400: 00000100:00100000:2.0:1783349724.522109:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349724.522159:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349724.522167:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c725b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666724352:0@lo:400: 00000100:00100000:0.0:1783349724.522170:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349724.522194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349724.522223:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724224 00000100:00100000:2.0:1783349724.522227:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724480 00000100:00100000:2.0:1783349724.522230:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724480 00000100:00100000:0.0:1783349724.522230:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724224 00000100:00100000:2.0:1783349724.522268:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724352 00000100:00100000:2.0:1783349724.522271:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724352 00000100:00100000:0.0:1783349724.522271:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349724.522279:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3293:x1869977666724224:12345-0@lo:400: 00000100:00100000:2.0:1783349724.522305:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349724.522311:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666724480:12345-0@lo:400: 00000100:00080000:1.0:1783349724.522321:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349724.522328:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3293:x1869977666724224:12345-0@lo:400: Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349724.522336:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783349724.522357:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349724.522358:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666724480:12345-0@lo:400: Request processed in 44us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349724.522367:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349724.522373:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666724352:12345-0@lo:400: 00010000:00080000:2.0:1783349724.522407:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c7258000 x1869977666724480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349724.522421:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666724352:12345-0@lo:400: Request processed in 53us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349724.522422:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666724480:0@lo:400: 00000100:00100000:1.0:1783349724.522435:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783349724.522458:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c725b480 x1869977666724352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349724.522469:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c725b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666724352:0@lo:400: 00000100:00100000:2.0:1783349724.522478:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c725b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666724224:0@lo:400: 00010000:00010000:2.0:1783349724.842392:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349725.866993:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783349726.571682:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783349726.571690:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320c6fcb000 from 21 10000000:01000000:3.0:1783349726.571695:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783349726.571733:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.571744:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.571755:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349726.571776:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666724608:0@lo:101: 00000100:00100000:3.0:1783349726.571871:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.571907:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349726.572018:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724608 00000100:00100000:2.0:1783349726.572026:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724608 00000100:00100000:2.0:1783349726.572467:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783349726.572478:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666724608:12345-0@lo:101: 00010000:00010000:2.0:1783349726.572491:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349726.572504:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484760ac expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349726.572526:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484760ac expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349726.572536:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760ac expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349726.572555:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050c00, rc 0) 00000100:00100000:2.0:1783349726.572605:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666724608:12345-0@lo:101: Request processed in 129us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349726.572612:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783349726.572691:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666724608:0@lo:101: 00010000:00010000:0.0:1783349726.572705:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.572713:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349726.572764:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666724736:0@lo:501: 00000100:00100000:0.0:1783349726.572813:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349726.572908:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349726.572934:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724736 00000100:00100000:3.0:1783349726.572938:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724736 00000100:00100000:3.0:1783349726.572957:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783349726.572963:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666724736:12345-0@lo:501: 00000100:00100000:3.0:1783349726.573623:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666724736:12345-0@lo:501: Request processed in 659us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349726.573630:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783349726.573740:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666724736:0@lo:501: 00000100:00100000:2.0:1783349726.573769:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c725b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666724864:0@lo:503: 00000100:00100000:2.0:1783349726.574197:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349726.574218:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e5f71c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.574359:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724864 00000100:00100000:0.0:1783349726.574366:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724864 00000100:00100000:0.0:1783349726.574401:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783349726.574409:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666724864:12345-0@lo:503: 00000100:00100000:0.0:1783349726.574725:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666724864:12345-0@lo:503: Request processed in 315us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.574733:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783349726.575065:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c725b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666724864:0@lo:503: 00000100:00100000:3.0:1783349726.576504:0:7162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7162:1869977666724992:0@lo:502: 00000100:00100000:3.0:1783349726.576557:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.577359:0:7162:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.577656:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666724992 00000100:00100000:0.0:1783349726.577664:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666724992 00000100:00100000:0.0:1783349726.577718:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349726.577727:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7162:x1869977666724992:12345-0@lo:502: 00000100:00100000:0.0:1783349726.578044:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7162:x1869977666724992:12345-0@lo:502: Request processed in 318us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.578052:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349726.578099:0:7162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7162:1869977666724992:0@lo:502: 00000100:00100000:0.0:1783349726.578146:0:7162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7162:1869977666725120:0@lo:502: 00000100:00100000:0.0:1783349726.578192:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349726.578218:0:7162:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d06819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349726.578257:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725120 00000100:00100000:3.0:1783349726.578262:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725120 00000100:00100000:3.0:1783349726.578291:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783349726.578298:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7162:x1869977666725120:12345-0@lo:502: 00000100:00100000:3.0:1783349726.578586:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7162:x1869977666725120:12345-0@lo:502: Request processed in 288us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349726.578594:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783349726.578615:0:7162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7162:1869977666725120:0@lo:502: 00000040:00080000:0.0:1783349726.578637:0:7162:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1783349726.578719:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1783349726.578740:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349726.578750:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349726.578761:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349726.578770:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783349726.578773:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320c6fcb000 from 4 10000000:01000000:2.0:1783349726.578776:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783349726.578855:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349726.578864:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349726.578872:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349726.578895:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c725b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725248:0@lo:101: 00000100:00100000:2.0:1783349726.578922:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349726.578951:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f76a8540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.579020:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725248 00000100:00100000:0.0:1783349726.579024:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725248 00000100:00100000:0.0:1783349726.579060:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783349726.579069:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666725248:12345-0@lo:101: 00010000:00010000:0.0:1783349726.579079:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349726.579093:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484760ba expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.579115:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484760ba expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.579126:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760ba expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.579147:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0031200, rc 0) 00000100:00100000:0.0:1783349726.579195:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666725248:12345-0@lo:101: Request processed in 128us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.579201:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783349726.579356:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c725b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725248:0@lo:101: 00010000:00010000:3.0:1783349726.579369:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.579378:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349726.579419:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725376:0@lo:256: 00000100:00100000:3.0:1783349726.579459:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.579478:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:3.0:1783349726.579491:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725376 00000100:00100000:3.0:1783349726.579495:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725376 00000100:00100000:3.0:1783349726.579516:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783349726.579524:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666725376:12345-0@lo:256: 20000000:01000000:3.0:1783349726.579537:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783349726.579552:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783349726.579555:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1783349726.579620:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666725376:12345-0@lo:256: Request processed in 97us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349726.579627:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783349726.579656:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725376:0@lo:256: 10000000:01000000:3.0:1783349726.579694:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783349726.579700:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.579709:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349726.579716:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783349726.579718:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1783349726.579720:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783349726.579736:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.579744:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.579761:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349726.579772:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725504:0@lo:101: 00000100:00100000:3.0:1783349726.579987:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349726.580058:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725504 00000100:00100000:0.0:1783349726.580063:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725504 00000100:00100000:3.0:1783349726.580069:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.580091:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783349726.580098:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666725504:12345-0@lo:101: 00010000:00010000:0.0:1783349726.580107:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349726.580116:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484760c8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.580129:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.580139:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.580144:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030400, rc 0) 00000100:00100000:0.0:1783349726.580166:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666725504:12345-0@lo:101: Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.580185:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783349726.580198:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725504:0@lo:101: 00010000:00010000:3.0:1783349726.580212:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.580220:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349726.580268:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725632:0@lo:501: 00000100:00100000:3.0:1783349726.580291:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349726.580736:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725632 00000100:00100000:3.0:1783349726.580740:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.580742:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725632 00000100:00100000:0.0:1783349726.580770:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349726.580777:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666725632:12345-0@lo:501: 00000100:00100000:0.0:1783349726.580966:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666725632:12345-0@lo:501: Request processed in 189us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.580976:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783349726.581068:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725632:0@lo:501: 00000100:00100000:3.0:1783349726.581095:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725760:0@lo:503: 00000100:00100000:3.0:1783349726.581196:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.581262:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349726.581373:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725760 00000100:00100000:2.0:1783349726.581378:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725760 00000100:00100000:2.0:1783349726.581448:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783349726.581457:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666725760:12345-0@lo:503: 00000100:00100000:2.0:1783349726.581722:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666725760:12345-0@lo:503: Request processed in 267us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349726.581730:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349726.581789:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666725760:0@lo:503: 00000100:00100000:3.0:1783349726.582558:0:7163:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7163:1869977666725888:0@lo:502: 00000100:00100000:3.0:1783349726.582598:0:7163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.582625:0:7163:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.582842:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666725888 00000100:00100000:0.0:1783349726.582848:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666725888 00000100:00100000:0.0:1783349726.582882:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783349726.582891:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7163:x1869977666725888:12345-0@lo:502: 00000100:00100000:0.0:1783349726.583168:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7163:x1869977666725888:12345-0@lo:502: Request processed in 277us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.583185:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783349726.583201:0:7163:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7163:1869977666725888:0@lo:502: 00000020:01000000:3.0:1783349726.583225:0:7163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783349726.583236:0:7163:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783349726.583242:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349726.583244:0:7163:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783349726.583249:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783349726.583253:0:7163:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.136@tcp to nid 0x20000c0a8cc88 (192.168.204.136@tcp) 00000020:01000000:3.0:1783349726.583273:0:7163:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783349726.583277:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783349726.583290:0:7163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9320c75ecd40) 00000020:00000080:3.0:1783349726.583306:0:7163:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1783349726.583311:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783349726.583379:0:7163:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783349726.583384:0:7163:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783349726.583393:0:7163:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a484760dd 00010000:00080000:3.0:1783349726.583420:0:7163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320dab71000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.136@tcp at head 00010000:00010000:3.0:1783349726.583638:0:7163:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783349726.612039:0:7163:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783349726.612062:0:7163:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783349726.612708:0:7163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349726.612886:0:7163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349726.612938:0:7163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1783349726.612999:0:7163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783349726.619182:0:7168:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349726.619191:0:7168:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783349726.621646:0:7163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783349726.621660:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783349726.621703:0:7163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783349726.621727:0:7163:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484760e4 00000100:00080000:3.0:1783349726.621739:0:7163:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349726.621752:0:7163:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9320dab71000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:3.0:1783349726.621812:0:7163:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320f7ae3100 x1869977666726016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783349726.621834:0:7163:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783349726.621898:0:7163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349726.621904:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349726.621906:0:7163:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783349726.621910:0:7163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349726.621915:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349726.621917:0:7163:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000100:00100000:1.0:1783349726.622027:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666726016:0@lo:8: 00000100:00100000:1.0:1783349726.622101:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349726.622337:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726016 00000100:00100000:1.0:1783349726.622344:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726016 00000100:00100000:1.0:1783349726.622372:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349726.622379:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1869977666726016:12345-0@lo:8: 00010000:00080000:1.0:1783349726.622404:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:1.0:1783349726.622434:0:6578:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484760eb 00002000:00100000:1.0:1783349726.622488:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9320fb53a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783349726.622493:0:6578:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1783349726.622497:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783349726.622602:0:6578:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783349726.622727:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783349726.622751:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9320fb539000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349726.622844:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1869977666726016:12345-0@lo:8: Request processed in 462us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349726.622852:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349726.622882:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666726144:0@lo:400: 00000100:00100000:1.0:1783349726.622915:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349726.623019:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666726272:0@lo:400: 00000100:00100000:1.0:1783349726.623046:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783349726.623228:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783349726.623231:0:7163:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783349726.623257:0:7163:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7163:1869977666726400:0@lo:502: 00000100:00100000:3.0:1783349726.623307:0:7163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.623347:0:7163:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:1.0:1783349726.623412:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726144 00000100:00100000:1.0:1783349726.623418:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726144 00000100:00100000:1.0:1783349726.623450:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726272 00000100:00100000:1.0:1783349726.623453:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726272 00000100:00100000:3.0:1783349726.623479:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783349726.623492:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666726144:12345-0@lo:400: 00000100:00100000:1.0:1783349726.623501:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783349726.623511:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666726272:12345-0@lo:400: 00000100:00100000:3.0:1783349726.623546:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666726144:12345-0@lo:400: Request processed in 58us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349726.623565:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666726272:12345-0@lo:400: Request processed in 54us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.623571:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726400 00000100:00100000:1.0:1783349726.623573:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783349726.623576:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726400 00000100:00080000:1.0:1783349726.623602:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349726.623603:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783349726.623611:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7163:x1869977666726400:12345-0@lo:502: 00000100:00100000:3.0:1783349726.623630:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783349726.623638:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc0a80 x1869977666726272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349726.623653:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666726272:0@lo:400: 00010000:00080000:1.0:1783349726.623699:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc3100 x1869977666726144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349726.623709:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666726144:0@lo:400: 00010000:00080000:1.0:1783349726.623738:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320f7ae3100 x1869977666726016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349726.623746:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783349726.623752:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783349726.623760:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783349726.623766:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783349726.623769:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320dab71000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783349726.623783:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783349726.623789:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666726016:0@lo:8: 00000004:00080000:3.0:1783349726.623824:0:7168:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783349726.623846:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7163:x1869977666726400:12345-0@lo:502: Request processed in 234us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.623853:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783349726.623859:0:7163:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7163:1869977666726400:0@lo:502: 00000020:01000000:3.0:1783349726.623892:0:7163:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349726.623899:0:7163:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349726.623903:0:7163:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783349726.623909:0:7163:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1783349726.623980:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1783349726.623995:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783349726.624005:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.624015:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349726.624026:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783349726.624029:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9320c75e8000 from 1 10000000:01000000:3.0:1783349726.624032:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783349726.624056:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.624073:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.624081:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349726.624093:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666726528:0@lo:101: 00000100:00100000:3.0:1783349726.624120:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.624150:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.624165:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726528 00000100:00100000:0.0:1783349726.624182:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726528 00000100:00100000:0.0:1783349726.624214:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349726.624224:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666726528:12345-0@lo:101: 00010000:00010000:0.0:1783349726.624240:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349726.624251:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484760f2 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.624274:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.624285:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349726.624293:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030c00, rc 0) 00000100:00100000:0.0:1783349726.624337:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666726528:12345-0@lo:101: Request processed in 116us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.624345:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783349726.624349:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666726528:0@lo:101: 00010000:00010000:3.0:1783349726.624365:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349726.624375:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349726.624427:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666726656:0@lo:501: 00000100:00100000:3.0:1783349726.624462:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349726.624495:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349726.624832:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726656 00000100:00100000:0.0:1783349726.624836:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726656 00000100:00100000:0.0:1783349726.624861:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783349726.624866:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666726656:12345-0@lo:501: 00000100:00100000:0.0:1783349726.625000:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666726656:12345-0@lo:501: Request processed in 135us (539us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349726.625005:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783349726.625048:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666726656:0@lo:501: 10000000:01000000:1.0:1783349726.625072:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783349726.625078:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349726.625087:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349726.625410:0:7168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 113687617043ns, next at 0ns, rc = 0 00000001:00100000:1.0:1783349726.655474:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1783349726.656035:0:5807:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783349726.656248:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666726784:0@lo:13: 00000100:00100000:3.0:1783349726.656321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783349726.656421:0:7169:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783349726.656445:0:7169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666726912:0@lo:7: 00000100:00100000:1.0:1783349726.656472:0:7169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349726.656489:0:7169:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349726.656530:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726912 00000100:00100000:2.0:1783349726.656539:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726912 00000100:00080000:1.0:1783349726.656607:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349726.656614:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349726.656624:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7169:x1869977666726912:12345-0@lo:7: 00000100:00100000:0.0:1783349726.656634:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666726784 00000100:00100000:0.0:1783349726.656638:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666726784 00000100:00100000:0.0:1783349726.656671:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349726.656678:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869977666726784:12345-0@lo:13: 00002000:00000024:0.0:1783349726.656699:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783349726.656746:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869977666726784:12345-0@lo:13: Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349726.656761:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783349726.656772:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc3100 x1869977666726784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349726.656815:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666726784:0@lo:13: 00002000:00080000:2.0:1783349726.670378:0:6580:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783349726.670388:0:6580:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783349726.670517:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7169:x1869977666726912:12345-0@lo:7: Request processed in 13890us (14039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349726.670529:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783349726.670603:0:7169:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc0a80 x1869977666726912/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783349742 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349726.670614:0:7169:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666726912:0@lo:7: 00000004:00080000:0.0:1783349726.670626:0:7169:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783349726.670667:0:7169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666727040:0@lo:5: 00000100:00100000:0.0:1783349726.670698:0:7169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349726.670744:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727040 00000100:00100000:2.0:1783349726.670751:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727040 00000100:00100000:0.0:1783349726.670751:0:7169:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349726.670819:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349726.670829:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7169:x1869977666727040:12345-0@lo:5: 00002000:00080000:2.0:1783349726.670853:0:6579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783349726.670857:0:6579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783349726.671605:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7169:x1869977666727040:12345-0@lo:5: Request processed in 776us (904us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783349726.671619:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783349726.671697:0:7169:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320f7182680 x1869977666727040/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349742 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349726.671712:0:7169:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666727040:0@lo:5: 00000004:00080000:1.0:1783349726.671724:0:7169:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783349726.671753:0:7169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666727168:0@lo:700: 00000100:00100000:1.0:1783349726.671819:0:7169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349726.671855:0:7169:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349726.671880:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727168 00000100:00100000:1.0:1783349726.671885:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727168 00000100:00100000:1.0:1783349726.671930:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349726.671942:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:7169:x1869977666727168:12345-0@lo:700: 00000100:00100000:1.0:1783349726.671978:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6587:1869977666727296:0@lo:700: 00000100:00100000:1.0:1783349726.672011:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349726.672037:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da000 going to sleep for 11 seconds 00000100:00100000:2.0:1783349726.672038:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727296 00000100:00100000:2.0:1783349726.672044:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727296 00000100:00100000:2.0:1783349726.672067:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349726.672074:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6587:x1869977666727296:12345-0@lo:700: 40000000:02000000:2.0:1783349726.706161:0:5791:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1783349726.718087:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6587:x1869977666727296:12345-0@lo:700: Request processed in 46003us (46067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349726.718100:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783349726.718350:0:6587:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc0e00 x1869977666727296/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783349742 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349726.718367:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6587:1869977666727296:0@lo:700: 40000000:02000000:1.0:1783349726.718380:0:6587:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1783349726.731104:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1783349726.754242:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7169:x1869977666727168:12345-0@lo:700: Request processed in 82293us (82439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349726.754258:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783349726.754271:0:7169:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc1880 x1869977666727168/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783349742 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349726.754285:0:7169:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783349726.754303:0:7169:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666727168:0@lo:700: 00000004:02000040:0.0:1783349726.791075:0:7169:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1783349726.795019:0:7169:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666727424:0@lo:5: 00000100:00100000:1.0:1783349726.795091:0:7169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349726.795145:0:7169:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349726.795347:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727424 00000100:00100000:2.0:1783349726.795354:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727424 00000100:00100000:2.0:1783349726.795458:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349726.795468:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7169:x1869977666727424:12345-0@lo:5: 00002000:00080000:2.0:1783349726.808409:0:6580:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783349726.808434:0:6580:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1783349726.815144:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7169:x1869977666727424:12345-0@lo:5: Request processed in 19670us (20046us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783349726.815159:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783349726.815246:0:7169:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c4fc1880 x1869977666727424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349742 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349726.815264:0:7169:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7169:1869977666727424:0@lo:5: 00000004:00080000:0.0:1783349726.815280:0:7169:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:00080000:3.0:1783349726.861972:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1783349726.889969:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349727.918373:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349728.938962:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783349729.629034:0:7475:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783349729.629038:0:7475:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783349729.629187:0:7475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9320c970f800 00000020:01000004:2.0:1783349729.629205:0:7475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783349729.629217:0:7475:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783349729.629240:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9320c79dcd40) 00000020:00000080:2.0:1783349729.629261:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783349729.642734:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1783349729.643234:0:7475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1783349729.660419:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1783349729.664690:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783349729.664722:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1783349729.664776:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783349729.664831:0:7475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1783349729.665403:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783349729.665415:0:7475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783349729.665425:0:7475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x68b4a22a48476107 00000020:01000004:1.0:1783349729.665433:0:7475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783349729.665452:0:7475:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.136@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783349729.665456:0:7475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783349729.665462:0:7475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783349729.665482:0:7475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783349729.665486:0:7475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783349729.679375:0:7475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783349729.679405:0:7475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.136@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783349729.679407:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783349729.679409:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783349729.679410:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783349729.679410:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783349729.679412:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783349729.679412:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783349729.679413:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783349729.679414:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783349729.679415:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783349729.679416:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783349729.679417:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783349729.679422:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783349729.679423:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783349729.679424:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783349729.679425:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783349729.679425:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783349729.679426:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783349729.679426:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783349729.679427:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783349729.679428:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783349729.679428:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783349729.679429:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783349729.679429:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783349729.679455:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783349729.679471:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666727552:0@lo:253: 00000100:00100000:1.0:1783349729.679544:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.679606:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.679684:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727552 00000100:00100000:0.0:1783349729.679690:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727552 00000100:00100000:0.0:1783349729.679732:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783349729.679738:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:7475:x1869977666727552:12345-0@lo:253: 20000000:01000000:0.0:1783349729.679760:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783349729.679763:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1783349729.679766:0:5779:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1783349729.679768:0:5779:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1783349729.680656:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349729.680891:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1783349729.680905:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1783349729.680943:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1783349729.680950:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1783349729.680989:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1783349729.681039:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1783349729.681389:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1783349729.681406:0:5779:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.136@tcp 20000000:01000000:0.0:1783349729.681408:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.136@tcp (null) (null) (null) 00000040:00080000:0.0:1783349729.681442:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1783349729.681450:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783349729.681498:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1783349729.681506:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.136@tcp (null) (null) 00000040:00080000:0.0:1783349729.681537:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783349729.681546:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783349729.681572:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783349729.681609:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1783349729.682357:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1783349729.682372:0:5779:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.136@tcp 20000000:01000000:0.0:1783349729.682374:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.136@tcp (null) (null) (null) 00000040:00080000:0.0:1783349729.682407:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1783349729.682414:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783349729.682458:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1783349729.682465:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.136@tcp (null) (null) 00000040:00080000:0.0:1783349729.682494:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1783349729.682502:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783349729.682546:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1783349729.682582:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1783349729.682597:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1783349729.682600:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1783349729.682605:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783349729.682606:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783349729.682608:0:5779:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783349729.682618:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783349729.682620:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783349729.682649:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783349729.682656:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783349729.684343:0:7477:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1783349729.684424:0:7477:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1783349729.684457:0:7477:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1783349729.684757:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1783349729.684873:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1783349729.684956:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1783349729.684969:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783349729.684971:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783349729.685377:0:7478:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1783349729.685522:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1783349729.685546:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1783349729.685598:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1783349729.685610:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783349729.685612:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783349729.686770:0:7479:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1783349729.686926:0:7479:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1783349729.686987:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1783349729.687257:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1783349729.687280:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1783349729.687310:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1783349729.687318:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783349729.687320:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783349729.688945:0:7480:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1783349729.689000:0:7480:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1783349729.689036:0:7480:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1783349729.689338:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1783349729.689377:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1783349729.689414:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1783349729.689430:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783349729.689449:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689467:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476058 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689475:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476082 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689482:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760ac expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689489:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689497:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689505:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689539:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689560:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 16 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.689575:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666727680:0@lo:104: 00000100:00100000:0.0:1783349729.689642:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349729.689743:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689751:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 16 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.689759:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666727808:0@lo:104: 00010000:00010000:0.0:1783349729.689780:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484760ac expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689787:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484760ac expref: 16 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.689824:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666727936:0@lo:104: 00010000:00010000:0.0:1783349729.689848:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476082 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689855:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476082 expref: 16 pid: 5778 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.689863:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666728064:0@lo:104: 00010000:00010000:0.0:1783349729.689885:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476058 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.689904:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476058 expref: 16 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.689913:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666728192:0@lo:104: 00000100:00100000:0.0:1783349729.689948:0:5779:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f769cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.690072:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783349729.690087:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.690097:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.690101:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.690107:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.690123:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727680 00000100:00100000:3.0:1783349729.690130:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727680 00000100:00100000:3.0:1783349729.690157:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727808 00000100:00100000:3.0:1783349729.690160:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727808 00000100:00100000:2.0:1783349729.690164:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666727936 00000100:00100000:2.0:1783349729.690167:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666727936 00000100:00100000:3.0:1783349729.690169:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728064 00000100:00100000:3.0:1783349729.690172:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728064 00000100:00100000:3.0:1783349729.690179:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728192 00000100:00100000:3.0:1783349729.690181:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728192 00000100:00100000:3.0:1783349729.690193:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349729.690200:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7476450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+7:5779:x1869977666727680:12345-0@lo:104: 00010000:00010000:3.0:1783349729.690212:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690305:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349729.690312:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7476450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+7:5779:x1869977666727680:12345-0@lo:104: Request processed in 112us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.690319:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783349729.690323:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349729.690330:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690346:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003800 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349729.690349:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690356:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690361:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 10000000:00010000:1.0:1783349729.690367:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690372:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:5779:x1869977666727808:12345-0@lo:104: 10000000:01000000:1.0:1783349729.690378:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349729.690384:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690421:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690429:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1783349729.690429:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783349729.690437:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:5779:x1869977666727808:12345-0@lo:104: Request processed in 67us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.690444:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1783349729.690454:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690461:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783349729.690462:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9003800/0x68b4a22a484760f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760f9 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690473:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:5779:x1869977666728064:12345-0@lo:104: 00010000:00010000:1.0:1783349729.690474:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349729.690478:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690484:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690484:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349729.690488:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690509:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349729.690516:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.690517:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666727680:0@lo:104: 00010000:00010000:3.0:1783349729.690523:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349729.690531:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666727808:0@lo:104: 00000100:00100000:3.0:1783349729.690532:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:5779:x1869977666728064:12345-0@lo:104: Request processed in 61us (426us total) trans 0 rc 0/0 10000000:01000000:1.0:1783349729.690532:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783349729.690542:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349729.690542:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666728064:0@lo:104: 00000100:00100000:3.0:1783349729.690553:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349729.690560:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:5779:x1869977666728192:12345-0@lo:104: 00010000:00010000:3.0:1783349729.690568:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690570:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690583:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349729.690589:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690597:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9002600/0x68b4a22a484760c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760cf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690610:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349729.690614:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690616:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1783349729.690623:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030a00 already unused, calling callback (ffffffffc1d04c20) 00000100:00100000:3.0:1783349729.690625:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:5779:x1869977666728192:12345-0@lo:104: Request processed in 65us (515us total) trans 0 rc 0/0 10000000:00010000:1.0:1783349729.690628:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690637:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1783349729.690653:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690654:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349729.690665:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666727936:12345-0@lo:104: 10000000:00010000:1.0:1783349729.690666:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690673:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.690675:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666728192:0@lo:104: 10000000:01000000:1.0:1783349729.690687:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349729.690719:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690726:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1783349729.690727:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783349729.690735:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5779:x1869977666727936:12345-0@lo:104: Request processed in 72us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.690741:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1783349729.690748:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690756:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c0030a00/0x68b4a22a48476082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476089 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.690763:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349729.690770:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349729.690774:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690780:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc1d04c20) 00000100:00100000:3.0:1783349729.690782:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:00010000:1.0:1783349729.690784:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690819:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666728576:0@lo:103: 00010000:00010000:1.0:1783349729.690843:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.690849:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1783349729.690857:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349729.690863:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783349729.690885:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728576 00000100:00100000:3.0:1783349729.690889:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728576 00010000:00010000:1.0:1783349729.690899:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690906:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349729.690908:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476082 expref: 17 pid: 5778 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690926:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690934:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9003a00/0x68b4a22a484760ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760b3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.690943:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349729.690944:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349729.690946:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349729.690957:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666728320:0@lo:103: 00000100:00100000:1.0:1783349729.690986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.691013:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728320 00000100:00100000:3.0:1783349729.691018:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728320 00010000:00010000:3.0:1783349729.691032:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 18 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.691048:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5779:1869977666727936:0@lo:104: 00000100:00100000:3.0:1783349729.691049:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783349729.691056:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349729.691061:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:3294:x1869977666728576:12345-0@lo:103: 00000100:00100000:1.0:1783349729.691067:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666728448:0@lo:103: 00010000:00010000:3.0:1783349729.691074:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349729.691081:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476082 expref: 18 pid: 5778 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.691088:0:5779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691093:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476082 expref: 18 pid: 5778 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.691101:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.691320:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349729.691329:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666728704:0@lo:103: 00000100:00100000:1.0:1783349729.691352:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349729.691555:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673d000/0x68b4a22a48476089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476082 expref: 18 pid: 5778 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691579:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349729.691605:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3294:x1869977666728576:12345-0@lo:103: Request processed in 547us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.691611:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349729.691623:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728448 00000100:00100000:3.0:1783349729.691627:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728448 00010000:00010000:3.0:1783349729.691638:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 17 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.691649:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728704 00000100:00100000:3.0:1783349729.691651:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728704 00010000:00010000:3.0:1783349729.691660:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760ac expref: 18 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.691672:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349729.691677:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:3291:x1869977666728320:12345-0@lo:103: 00010000:00010000:3.0:1783349729.691684:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349729.691688:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 18 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691696:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 18 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691706:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030c00/0x68b4a22a484760f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484760f2 expref: 18 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691716:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349729.691745:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3291:x1869977666728320:12345-0@lo:103: Request processed in 67us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.691760:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349729.691777:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783349729.691781:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666728320:0@lo:103: 00000100:00100000:3.0:1783349729.691788:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3291:x1869977666728448:12345-0@lo:103: 00010000:00010000:3.0:1783349729.691830:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349729.691835:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 16 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691845:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 16 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691855:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030400/0x68b4a22a484760cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484760c8 expref: 16 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.691866:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349729.691889:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666728576:0@lo:103: 00000100:00100000:3.0:1783349729.691911:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:3291:x1869977666728448:12345-0@lo:103: Request processed in 125us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.691919:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783349729.691974:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666728448:0@lo:103: 00000100:00100000:3.0:1783349729.692003:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349729.692011:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3293:x1869977666728704:12345-0@lo:103: 00010000:00010000:3.0:1783349729.692020:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349729.692025:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760ac expref: 14 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692034:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484760ac expref: 14 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692045:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050c00/0x68b4a22a484760b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484760ac expref: 14 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692064:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349729.692097:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:3293:x1869977666728704:12345-0@lo:103: Request processed in 87us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.692103:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783349729.692236:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666728704:0@lo:103: 00010000:00010000:2.0:1783349729.692400:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349729.692403:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349729.692405:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349729.692441:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.692454:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030e00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349729.692458:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.692466:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349729.692473:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349729.692484:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783349729.692515:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.692521:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783349729.692587:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666728832:0@lo:103: 00000100:00100000:1.0:1783349729.692617:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349729.692639:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.692648:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48476058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847605f expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.692656:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728832 00000100:00100000:3.0:1783349729.692662:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728832 00010000:00010000:0.0:1783349729.692665:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349729.692669:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349729.692671:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349729.692681:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476058 expref: 13 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.692714:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349729.692720:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:3291:x1869977666728832:12345-0@lo:103: 00010000:00010000:3.0:1783349729.692728:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349729.692732:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476058 expref: 13 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692740:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476058 expref: 13 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692748:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673d200/0x68b4a22a4847605f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476058 expref: 13 pid: 5777 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692758:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692766:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692780:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692818:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692825:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692831:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692834:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349729.692837:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692842:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692854:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.692860:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349729.692882:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3291:x1869977666728832:12345-0@lo:103: Request processed in 163us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.692886:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783349729.692927:0:5779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.692936:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.692942:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030600/0x68b4a22a4847610e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783349729.692958:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783349729.692995:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666728832:0@lo:103: 00000100:00100000:2.0:1783349729.738588:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:7475:x1869977666727552:12345-0@lo:253: Request processed in 58839us (59034us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.738604:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783349729.738924:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666727552:0@lo:253: 10000000:01000000:1.0:1783349729.738939:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783349729.738955:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783349729.738957:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783349729.738958:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783349729.738959:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783349729.738961:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783349729.738962:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783349729.738964:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783349729.738976:0:7475:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783349729.738978:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783349729.738979:0:7475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783349729.739005:0:7475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9320c970f800 from lustre-OST0001 10000000:01000000:1.0:1783349729.739029:0:7475:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783349729.739032:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783349729.739039:0:7475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9320c75e8000 local copy 10000000:01000000:1.0:1783349729.739042:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783349729.739334:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.739346:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.739356:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.739374:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666728960:0@lo:101: 00000100:00100000:1.0:1783349729.739415:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.739516:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc4648e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.739583:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666728960 00000100:00100000:0.0:1783349729.739590:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666728960 00000100:00100000:0.0:1783349729.739626:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349729.739637:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+11:7475:x1869977666728960:12345-0@lo:101: 00010000:00010000:0.0:1783349729.739651:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349729.739672:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030600/0x68b4a22a4847611c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476115 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.739695:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030600/0x68b4a22a4847611c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476115 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.739707:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030600/0x68b4a22a4847611c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476115 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.739715:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030600, rc 0) 00000100:00100000:0.0:1783349729.739756:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666728960:12345-0@lo:101: Request processed in 122us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349729.739763:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783349729.739859:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666728960:0@lo:101: 00010000:00010000:1.0:1783349729.739871:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.739880:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.739997:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729088:0@lo:501: 00000100:00100000:1.0:1783349729.740022:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349729.740083:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729088 00000100:00100000:0.0:1783349729.740088:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729088 00000100:00100000:0.0:1783349729.740129:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783349729.740136:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666729088:12345-0@lo:501: 00000100:00100000:0.0:1783349729.740356:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666729088:12345-0@lo:501: Request processed in 219us (332us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349729.740364:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783349729.740662:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc4648e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349729.740677:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729088:0@lo:501: 10000000:01000000:1.0:1783349729.740692:0:7475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783349729.740720:0:7475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783349729.740726:0:7475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.740735:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.740742:0:7475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.740845:0:7475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783349729.740865:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9320c970f800 10000000:01000000:1.0:1783349729.740870:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783349729.740875:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783349729.740878:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783349729.740883:0:7475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783349729.740885:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783349729.740906:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.740913:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.740932:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.740948:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729216:0@lo:101: 00000100:00100000:1.0:1783349729.740998:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.741026:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.741135:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729216 00000100:00100000:0.0:1783349729.741141:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729216 00000100:00100000:0.0:1783349729.741180:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783349729.741187:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666729216:12345-0@lo:101: 00010000:00010000:0.0:1783349729.741198:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349729.741208:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476123 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.741226:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476123 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.741243:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476123 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.741261:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030e00, rc 0) 00000100:00100000:0.0:1783349729.741301:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729216:12345-0@lo:101: Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349729.741308:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783349729.741435:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729216:0@lo:101: 00010000:00010000:1.0:1783349729.741446:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.741454:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.741510:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729344:0@lo:501: 00000100:00100000:1.0:1783349729.741538:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.741560:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.741883:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729344 00000100:00100000:0.0:1783349729.741888:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729344 00000100:00100000:0.0:1783349729.741923:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783349729.741930:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729344:12345-0@lo:501: 00000100:00100000:0.0:1783349729.742588:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729344:12345-0@lo:501: Request processed in 656us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349729.742596:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349729.742682:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729344:0@lo:501: 00000100:00100000:1.0:1783349729.742720:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729472:0@lo:503: 00000100:00100000:1.0:1783349729.742765:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.742818:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349729.742887:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729472 00000100:00100000:2.0:1783349729.742892:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729472 00000100:00100000:2.0:1783349729.742929:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783349729.742936:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729472:12345-0@lo:503: 00000100:00100000:2.0:1783349729.743092:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729472:12345-0@lo:503: Request processed in 156us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.743099:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:3.0:1783349729.743154:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349729.743163:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.743174:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7534200 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349729.743178:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.743199:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349729.743208:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349729.743214:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349729.743237:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.743243:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349729.743264:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.743271:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7534200/0x68b4a22a48476115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x68b4a22a4847611c expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.743285:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349729.743287:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349729.743288:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349729.743337:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349729.743349:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666729600:0@lo:103: 00000100:00100000:1.0:1783349729.743378:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.743432:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729472:0@lo:503: 00000040:00080000:1.0:1783349729.743698:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783349729.743770:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729728:0@lo:502: 00000100:00100000:1.0:1783349729.743821:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.743834:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a180 going to sleep for 11 seconds 00000100:00100000:2.0:1783349729.743904:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729728 00000100:00100000:2.0:1783349729.743909:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729728 00000100:00100000:2.0:1783349729.743940:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783349729.743947:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729728:12345-0@lo:502: 00000100:00100000:3.0:1783349729.744159:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729600 00000100:00100000:3.0:1783349729.744164:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729600 00000100:00100000:3.0:1783349729.744197:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349729.744205:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3291:x1869977666729600:12345-0@lo:103: 00010000:00010000:3.0:1783349729.744216:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349729.744231:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030600/0x68b4a22a4847611c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476115 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.744245:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349729.744445:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729728:12345-0@lo:502: Request processed in 498us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.744452:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783349729.744545:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3291:x1869977666729600:12345-0@lo:103: Request processed in 341us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.744552:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349729.744685:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729728:0@lo:502: 00000100:00100000:2.0:1783349729.745094:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666729600:0@lo:103: 00000040:00080000:1.0:1783349729.745202:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783349729.745330:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783349729.745369:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783349729.745419:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783349729.745456:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783349729.745487:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783349729.745517:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729856:0@lo:502: 00000100:00100000:1.0:1783349729.745562:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.745634:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349729.745676:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729856 00000100:00100000:2.0:1783349729.745682:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729856 00000100:00100000:2.0:1783349729.745761:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783349729.745769:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666729856:12345-0@lo:502: 00000100:00100000:2.0:1783349729.745980:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666729856:12345-0@lo:502: Request processed in 195us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.745987:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783349729.746065:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729856:0@lo:502: 00000040:00080000:1.0:1783349729.746156:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783349729.746166:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783349729.746667:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783349729.746675:0:7482:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783349729.746681:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349729.746683:0:7482:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783349729.746688:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783349729.746702:0:7482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9320d23599c0) 00000020:00000080:1.0:1783349729.746723:0:7482:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783349729.746729:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783349729.746811:0:7482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320c970f800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783349729.746819:0:7482:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783349729.746826:0:7482:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x68b4a22a48476138 00010000:00010000:1.0:1783349729.753511:0:7482:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1783349729.753843:0:7482:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1783349729.756479:0:7482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783349729.756759:0:7482:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1783349729.760695:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783349729.761393:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783349729.762534:0:7482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783349729.762544:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349729.762549:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349729.762551:0:7482:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783349729.762555:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349729.762560:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349729.762561:0:7482:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783349729.762565:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783349729.762567:0:7482:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783349729.762612:0:7482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349729.762617:0:7482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349729.762619:0:7482:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783349729.762623:0:7482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783349729.762786:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1783349729.762890:0:7475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783349729.762943:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.762954:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349729.762962:0:7475:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c970f800 from 1 10000000:01000000:3.0:1783349729.762965:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349729.763001:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.763010:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.763021:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.763046:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729984:0@lo:101: 00000100:00100000:3.0:1783349729.763142:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.763177:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.763253:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666729984 00000100:00100000:0.0:1783349729.763260:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666729984 00000100:00100000:0.0:1783349729.763313:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783349729.763324:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:7475:x1869977666729984:12345-0@lo:101: 00010000:00010000:0.0:1783349729.763337:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349729.763350:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847613f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.763372:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847613f expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.763383:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847613f expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.763404:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0031800, rc 0) 00000100:00100000:0.0:1783349729.763449:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666729984:12345-0@lo:101: Request processed in 127us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349729.763456:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783349729.763510:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666729984:0@lo:101: 00010000:00010000:0.0:1783349729.763524:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.763533:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349729.763627:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730112:0@lo:501: 00000100:00100000:0.0:1783349729.763659:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349729.763674:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f769c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.763852:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730112 00000100:00100000:3.0:1783349729.763856:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730112 00000100:00100000:3.0:1783349729.763883:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783349729.763891:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730112:12345-0@lo:501: 00000100:00100000:3.0:1783349729.764131:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730112:12345-0@lo:501: Request processed in 240us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.764144:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783349729.764199:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730112:0@lo:501: 00000100:00100000:2.0:1783349729.764231:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730240:0@lo:503: 00000100:00100000:2.0:1783349729.764273:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349729.764306:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.765038:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730240 00000100:00100000:3.0:1783349729.765045:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730240 00000100:00100000:3.0:1783349729.765090:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783349729.765097:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730240:12345-0@lo:503: 00000100:00100000:2.0:1783349729.765473:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730240:0@lo:503: 00000100:00100000:3.0:1783349729.765616:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730240:12345-0@lo:503: Request processed in 517us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.765625:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:2.0:1783349729.766049:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783349729.766121:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730368:0@lo:502: 00000100:00100000:2.0:1783349729.766160:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349729.766195:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.766273:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730368 00000100:00100000:0.0:1783349729.766279:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730368 00000100:00100000:0.0:1783349729.766316:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783349729.766324:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730368:12345-0@lo:502: 00000100:00100000:0.0:1783349729.766541:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730368:12345-0@lo:502: Request processed in 217us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349729.766549:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783349729.766613:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730368:0@lo:502: 00000040:00080000:2.0:1783349729.766915:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783349729.766979:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783349729.767007:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730496:0@lo:502: 00000100:00100000:2.0:1783349729.767063:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349729.767226:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349729.767278:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730496 00000100:00100000:0.0:1783349729.767283:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730496 00000100:00100000:0.0:1783349729.767314:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783349729.767322:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730496:12345-0@lo:502: 00000100:00100000:0.0:1783349729.767498:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730496:12345-0@lo:502: Request processed in 175us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349729.767512:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783349729.767610:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730496:0@lo:502: 00000040:00080000:2.0:1783349729.767733:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783349729.767743:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783349729.768392:0:7486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349729.768406:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349729.768409:0:7486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783349729.768417:0:7486:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320c970f800 00000020:00000080:3.0:1783349729.768420:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783349729.768442:0:7486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349729.768446:0:7486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349729.768448:0:7486:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783349729.768450:0:7486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783349729.768766:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783349729.768819:0:7475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349729.768838:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.768850:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349729.768891:0:7475:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783349729.768894:0:7475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9320c970f800 10000000:01000000:1.0:1783349729.768898:0:7475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9320c970f800 10000000:01000000:1.0:1783349729.768902:0:7475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783349729.768907:0:7475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320c970f800 from 1 10000000:01000000:1.0:1783349729.768910:0:7475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783349729.768936:0:7475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.768957:0:7475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.768972:0:7475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.768989:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730624:0@lo:101: 00000100:00100000:1.0:1783349729.769029:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.769059:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb50ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.769125:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730624 00000100:00100000:3.0:1783349729.769131:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730624 00000100:00100000:3.0:1783349729.769167:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783349729.769175:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666730624:12345-0@lo:101: 00010000:00010000:3.0:1783349729.769187:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349729.769198:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847614d expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.769219:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847614d expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.769230:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847614d expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.769245:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002a00, rc 0) 00000100:00100000:3.0:1783349729.769290:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666730624:12345-0@lo:101: Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.769297:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783349729.769574:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730624:0@lo:101: 00010000:00010000:1.0:1783349729.769590:0:7475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.769599:0:7475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.769687:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730752:0@lo:501: 00000100:00100000:1.0:1783349729.769716:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.769768:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb50ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.769869:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730752 00000100:00100000:3.0:1783349729.769874:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730752 00000100:00100000:3.0:1783349729.769936:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783349729.769946:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666730752:12345-0@lo:501: 00000100:00100000:3.0:1783349729.770162:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666730752:12345-0@lo:501: Request processed in 218us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.770169:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783349729.770248:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730752:0@lo:501: 00000100:00100000:0.0:1783349729.770278:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730880:0@lo:503: 00000100:00100000:0.0:1783349729.770318:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349729.770344:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f769c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349729.770414:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666730880 00000100:00100000:1.0:1783349729.770419:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666730880 00000100:00100000:1.0:1783349729.770455:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783349729.770463:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666730880:12345-0@lo:503: 00000100:00100000:1.0:1783349729.770621:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666730880:12345-0@lo:503: Request processed in 159us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349729.770630:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783349729.770720:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666730880:0@lo:503: 00000040:00080000:0.0:1783349729.771015:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349729.771175:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666731008:0@lo:502: 00000100:00100000:0.0:1783349729.771277:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349729.771342:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f769c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.771373:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731008 00000100:00100000:3.0:1783349729.771378:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731008 00000100:00100000:3.0:1783349729.771405:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783349729.771412:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666731008:12345-0@lo:502: 00000100:00100000:3.0:1783349729.771624:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666731008:12345-0@lo:502: Request processed in 211us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.771632:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783349729.771692:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666731008:0@lo:502: 00000040:00080000:0.0:1783349729.772018:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783349729.772260:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783349729.772305:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783349729.772357:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783349729.772395:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783349729.772447:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783349729.772486:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783349729.772520:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783349729.772582:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783349729.772621:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783349729.772656:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783349729.772707:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783349729.772744:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783349729.772880:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783349729.772951:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783349729.772989:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783349729.773135:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783349729.773254:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783349729.773299:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783349729.773336:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783349729.773380:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783349729.773414:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783349729.773441:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783349729.773478:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783349729.773504:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783349729.773527:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783349729.773560:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783349729.773585:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783349729.774947:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783349729.775210:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783349729.775274:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783349729.775367:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783349729.775404:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783349729.775449:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783349729.775483:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783349729.775527:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783349729.775611:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783349729.775668:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666731136:0@lo:502: 00000100:00100000:0.0:1783349729.775744:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349729.775784:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f769c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349729.775827:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731136 00000100:00100000:3.0:1783349729.775836:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731136 00000100:00100000:3.0:1783349729.775887:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783349729.775898:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666731136:12345-0@lo:502: 00000100:00100000:3.0:1783349729.776419:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666731136:12345-0@lo:502: Request processed in 521us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.776428:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783349729.776451:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666731136:0@lo:502: 00000040:00080000:0.0:1783349729.776550:0:7475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1783349729.776557:0:7475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1783349729.777529:0:7487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783349729.777543:0:7487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9320d2358000) 00000020:00000080:1.0:1783349729.777561:0:7487:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1783349729.778141:0:7487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320c970f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783349729.778146:0:7487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320c970f800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783349729.778151:0:7487:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320c970f800 3 00010000:00080000:3.0:1783349729.778221:0:7487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320c86b0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.136@tcp at head 00010000:00010000:3.0:1783349729.780152:0:7487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1783349729.780258:0:7487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783349729.780305:0:7487:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783349729.780316:0:7487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x68b4a22a48476162 00000100:00080000:3.0:1783349729.780327:0:7487:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349729.780332:0:7487:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9320c86b0000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:3.0:1783349729.780365:0:7487:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320f7ae0380 x1869977666731264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783349729.780394:0:7487:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1783349729.780623:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1783349729.780669:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666731520:0@lo:400: 00000020:01000000:0.0:1783349729.780732:0:7475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:2.0:1783349729.780735:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783349729.780750:0:7489:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9320f7ae3100 x1869977666731776/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349729.780761:0:7489:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca0600c0 going to sleep for 0 seconds 10000000:01000000:0.0:1783349729.780767:0:7475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1783349729.780771:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349729.780780:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666731392:0@lo:400: 00010000:00010000:0.0:1783349729.780787:0:7475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.780831:0:7475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349729.780839:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349729.780864:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349729.780871:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666731648:0@lo:400: 00000020:01000004:0.0:1783349729.780880:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783349729.780883:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783349729.780885:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349729.780887:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349729.780888:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349729.780890:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349729.780893:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1783349729.780896:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783349729.780897:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349729.780900:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349729.780902:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349729.780904:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783349729.780908:0:7475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1783349729.780911:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783349729.780912:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783349729.780914:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349729.780915:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349729.780917:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349729.780918:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349729.780920:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349729.780921:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349729.780923:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349729.780924:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349729.780925:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783349729.780937:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731648 10000000:01000000:0.0:1783349729.780940:0:7475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783349729.780944:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731648 00000100:00100000:2.0:1783349729.780990:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349729.780999:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666731648:12345-0@lo:400: 00000100:00100000:2.0:1783349729.781046:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666731648:12345-0@lo:400: Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.781053:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349729.781090:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666731264:0@lo:38: 00010000:00080000:2.0:1783349729.781105:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c7258700 x1869977666731648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349729.781127:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783349729.781141:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349729.781145:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666731648:0@lo:400: 00000100:00100000:1.0:1783349729.781184:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731520 00000100:00100000:1.0:1783349729.781189:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731520 00000100:00100000:1.0:1783349729.781248:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731392 00000100:00100000:3.0:1783349729.781250:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731264 00000100:00100000:1.0:1783349729.781252:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731392 00000100:00100000:3.0:1783349729.781257:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731264 00000100:00100000:3.0:1783349729.781279:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349729.781286:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666731520:12345-0@lo:400: 00000100:00100000:3.0:1783349729.781325:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666731520:12345-0@lo:400: Request processed in 40us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.781332:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349729.781345:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783349729.781349:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666731264:12345-0@lo:38: 00010000:00080000:3.0:1783349729.781365:0:5784:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 116 last 0 00000020:00000080:3.0:1783349729.781391:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x68b4a22a48476169 00000004:00100000:3.0:1783349729.781404:0:5784:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783349729.781429:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9320c86b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349729.781440:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783349729.781449:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666731392:12345-0@lo:400: 00000100:00100000:1.0:1783349729.781483:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666731392:12345-0@lo:400: Request processed in 35us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349729.781489:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783349729.781505:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349729.781509:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349729.781546:0:7475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666731904:0@lo:253: 00000100:00100000:0.0:1783349729.781589:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349729.781609:0:7475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f769c3c0 going to sleep for 11 seconds 00010000:00080000:2.0:1783349729.781679:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c7258000 x1869977666731392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349729.781690:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666731392:0@lo:400: 00010000:00080000:2.0:1783349729.781700:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320c7259f80 x1869977666731520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349729.781709:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666731520:0@lo:400: 00000100:00100000:3.0:1783349729.781944:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1869977666731264:12345-0@lo:38: Request processed in 592us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.781958:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349729.782046:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731904 00000100:00100000:1.0:1783349729.782051:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731904 00000100:00100000:1.0:1783349729.782087:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783349729.782095:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7475:x1869977666731904:12345-0@lo:253: 20000000:01000000:1.0:1783349729.782125:0:5778:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00080000:2.0:1783349729.782134:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320f7ae0380 x1869977666731264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 20000000:01000000:1.0:1783349729.782141:0:5778:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783349729.782144:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349729.782152:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783349729.782165:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783349729.782170:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783349729.782173:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c86b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783349729.782181:0:3290:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a5144cf4): req@ffff9320f7ae3100 x1869977666731776/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349729.782204:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666731264:0@lo:38: 00000100:00100000:3.0:1783349729.782528:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349729.782557:0:7489:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca0600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349729.782679:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666731776 00000100:00100000:2.0:1783349729.782683:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666731776 00000100:00080000:1.0:1783349729.782718:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349729.782766:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349729.782775:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7489:x1869977666731776:12345-0@lo:901: 00000100:00100000:2.0:1783349729.783253:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7489:x1869977666731776:12345-0@lo:901: Request processed in 479us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.783261:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783349729.783299:0:7489:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9320f7ae3100 x1869977666731776/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783349745 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349729.783310:0:7489:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7489:1869977666731776:0@lo:901: 20000000:01000000:0.0:1783349729.801335:0:5778:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783349729.801379:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783349729.801422:0:5800:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783349729.801425:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783349729.801443:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.801474:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484760ba expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.801482:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.801523:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484760ba expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349729.801658:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484760ba expref: 14 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349729.801675:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5800:1869977666732032:0@lo:104: 00000100:00100000:3.0:1783349729.801744:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349729.801825:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732032 00000100:00100000:3.0:1783349729.801832:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349729.801834:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732032 00000100:00100000:2.0:1783349729.801889:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349729.801899:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5800:x1869977666732032:12345-0@lo:104: 00010000:00010000:2.0:1783349729.801912:0:5768:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349729.801971:0:5768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349729.801978:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:5800:x1869977666732032:12345-0@lo:104: Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349729.802001:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349729.802015:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5800:1869977666732032:0@lo:104: 00010000:00010000:0.0:1783349729.802036:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802089:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349729.802096:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802127:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051400 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349729.802131:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802139:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349729.802152:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349729.802158:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349729.802485:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802493:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349729.802527:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802535:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484760ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484760c1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802553:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349729.802555:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349729.802558:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349729.802562:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349729.802580:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666732160:0@lo:103: 00000100:00100000:0.0:1783349729.802617:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349729.802771:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732160 00000100:00100000:1.0:1783349729.802777:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732160 00010000:00010000:1.0:1783349729.802838:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760ba expref: 15 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.802871:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783349729.802887:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:3291:x1869977666732160:12345-0@lo:103: 00010000:00010000:1.0:1783349729.802899:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349729.802905:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484760ba expref: 15 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802918:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484760ba expref: 15 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802932:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0031200/0x68b4a22a484760c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484760ba expref: 15 pid: 5779 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802946:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802954:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783349729.802966:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001540493s 00010000:00010000:1.0:1783349729.802970:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802978:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802984:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802989:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.802994:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349729.803004:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.803012:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.803032:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349729.803042:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349729.803067:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349729.803078:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.803079:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3291:x1869977666732160:12345-0@lo:103: Request processed in 194us (460us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349729.803094:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9002000/0x68b4a22a48476170 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349729.803096:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349729.803331:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666732160:0@lo:103: 00000100:00100000:3.0:1783349729.807841:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:7475:x1869977666731904:12345-0@lo:253: Request processed in 25738us (26243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349729.807856:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783349729.807882:0:7475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47d1b48f-2d78-45ee-b062-943ed61d9bed:7475:1869977666731904:0@lo:253: 10000000:01000000:0.0:1783349729.807899:0:7475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783349729.807903:0:7475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783349729.807905:0:7475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783349729.807906:0:7475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783349729.807908:0:7475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783349729.807909:0:7475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783349729.807910:0:7475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783349729.807912:0:7475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783349729.807913:0:7475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783349729.807915:0:7475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783349729.807917:0:7475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783349729.807918:0:7475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783349729.807931:0:7475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783349729.811770:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349729.812073:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349729.812225:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349729.812384:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349729.812566:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349729.812998:0:7475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783349729.813884:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783349729.914206:0:7475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783349729.914214:0:7475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783349729.914263:0:7475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783349729.914335:0:7475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783349729.914366:0:7475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783349729.914461:0:7475:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783349729.963671:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349730.988200:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349731.691630:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666732288:0@lo:13: 00000100:00100000:1.0:1783349731.691698:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349731.691936:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732288 00000100:00100000:0.0:1783349731.691943:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732288 00000100:00080000:2.0:1783349731.692013:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349731.692021:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349731.692031:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666732288:12345-0@lo:13: 00002000:00000024:0.0:1783349731.692066:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349731.692120:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666732288:12345-0@lo:13: Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349731.692127:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783349731.692282:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7180000 x1869977666732288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349731.692299:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666732288:0@lo:13: 00010000:00010000:0.0:1783349732.014598:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349733.036103:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783349733.290920:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783349733.290928:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320f70f3800 from 30 10000000:01000000:3.0:1783349733.290933:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783349733.290973:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349733.290985:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349733.290997:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349733.291020:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666732416:0@lo:101: 00000100:00100000:3.0:1783349733.291168:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.291224:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.291385:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732416 00000100:00100000:1.0:1783349733.291393:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732416 00000100:00100000:1.0:1783349733.291448:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783349733.291459:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666732416:12345-0@lo:101: 00010000:00010000:1.0:1783349733.291472:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349733.291486:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476177 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.291508:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476177 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.291531:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476177 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.291540:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d7534c00, rc 0) 00000100:00100000:1.0:1783349733.291591:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666732416:12345-0@lo:101: Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349733.291598:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783349733.292622:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666732416:0@lo:101: 00010000:00010000:2.0:1783349733.292641:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.292651:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349733.292716:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666732544:0@lo:501: 00000100:00100000:2.0:1783349733.292751:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.292786:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca1b2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.292887:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732544 00000100:00100000:3.0:1783349733.292893:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732544 00000100:00100000:3.0:1783349733.292931:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783349733.292939:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666732544:12345-0@lo:501: 00000100:00100000:3.0:1783349733.293294:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666732544:12345-0@lo:501: Request processed in 356us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349733.293302:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783349733.295019:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666732544:0@lo:501: 00000100:00100000:2.0:1783349733.295085:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666732672:0@lo:503: 00000100:00100000:2.0:1783349733.295147:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.295190:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732672 00000100:00100000:2.0:1783349733.295192:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca1b2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.295197:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732672 00000100:00100000:3.0:1783349733.295242:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783349733.295250:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666732672:12345-0@lo:503: 00000100:00100000:3.0:1783349733.295588:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666732672:12345-0@lo:503: Request processed in 337us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349733.295601:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783349733.295732:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666732672:0@lo:503: 00000100:00100000:2.0:1783349733.297636:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7797:1869977666732800:0@lo:502: 00000100:00100000:2.0:1783349733.297694:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.297734:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.297784:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732800 00000100:00100000:0.0:1783349733.297829:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732800 00000100:00100000:0.0:1783349733.297872:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783349733.297883:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7797:x1869977666732800:12345-0@lo:502: 00000100:00100000:0.0:1783349733.298192:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7797:x1869977666732800:12345-0@lo:502: Request processed in 311us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.298200:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783349733.298316:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7797:1869977666732800:0@lo:502: 00000100:00100000:2.0:1783349733.298363:0:7797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7797:1869977666732928:0@lo:502: 00000100:00100000:2.0:1783349733.298401:0:7797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.298438:0:7797:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.298480:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666732928 00000100:00100000:0.0:1783349733.298484:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666732928 00000100:00100000:0.0:1783349733.298514:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783349733.298522:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7797:x1869977666732928:12345-0@lo:502: 00000100:00100000:0.0:1783349733.298658:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:7797:x1869977666732928:12345-0@lo:502: Request processed in 136us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.298665:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783349733.298739:0:7797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7797:1869977666732928:0@lo:502: 00000040:00080000:2.0:1783349733.298759:0:7797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783349733.298957:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783349733.298980:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349733.298990:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299000:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349733.299010:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783349733.299013:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783349733.299016:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783349733.299041:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299062:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299073:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349733.299087:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733056:0@lo:101: 00000100:00100000:0.0:1783349733.299117:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.299142:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd6653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.299156:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733056 00000100:00100000:0.0:1783349733.299159:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733056 00000100:00100000:0.0:1783349733.299185:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783349733.299190:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666733056:12345-0@lo:101: 00010000:00010000:0.0:1783349733.299199:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349733.299210:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476185 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299239:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476185 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299249:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476185 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299257:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030a00, rc 0) 00000100:00100000:0.0:1783349733.299286:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666733056:12345-0@lo:101: Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.299291:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783349733.299320:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733056:0@lo:101: 00010000:00010000:0.0:1783349733.299332:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.299341:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349733.299376:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733184:0@lo:501: 00000100:00100000:0.0:1783349733.299398:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.299416:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd6653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.299480:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733184 00000100:00100000:1.0:1783349733.299484:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733184 00000100:00100000:1.0:1783349733.299511:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783349733.299520:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666733184:12345-0@lo:501: 00000100:00100000:1.0:1783349733.299735:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666733184:12345-0@lo:501: Request processed in 216us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349733.299741:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783349733.300031:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733184:0@lo:501: 00000100:00100000:0.0:1783349733.300073:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733312:0@lo:503: 00000100:00100000:0.0:1783349733.300111:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.300141:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd6653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349733.300214:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733312 00000100:00100000:2.0:1783349733.300220:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733312 00000100:00100000:2.0:1783349733.300253:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783349733.300260:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666733312:12345-0@lo:503: 00000100:00100000:2.0:1783349733.300617:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666733312:12345-0@lo:503: Request processed in 356us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.300624:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783349733.301140:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733312:0@lo:503: 00000100:00100000:3.0:1783349733.302084:0:7799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7799:1869977666733440:0@lo:502: 00000100:00100000:3.0:1783349733.302148:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.302188:0:7799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c5181600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.303749:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733440 00000100:00100000:0.0:1783349733.303758:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733440 00000100:00100000:0.0:1783349733.303825:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783349733.303834:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7799:x1869977666733440:12345-0@lo:502: 00000100:00100000:0.0:1783349733.304156:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7799:x1869977666733440:12345-0@lo:502: Request processed in 322us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.304165:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783349733.304734:0:7799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7799:1869977666733440:0@lo:502: 00000020:01000000:3.0:1783349733.304770:0:7799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349733.304779:0:7799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349733.304782:0:7799:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783349733.304787:0:7799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783349733.304819:0:7799:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783349733.304849:0:7799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7799:1869977666733568:0@lo:502: 00000100:00100000:3.0:1783349733.304900:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.304940:0:7799:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c5181600 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.305136:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733568 00000100:00100000:1.0:1783349733.305142:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733568 00000100:00100000:1.0:1783349733.305168:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783349733.305176:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7799:x1869977666733568:12345-0@lo:502: 00000100:00100000:1.0:1783349733.305339:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:7799:x1869977666733568:12345-0@lo:502: Request processed in 164us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349733.305347:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783349733.305422:0:7799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7799:1869977666733568:0@lo:502: 00000020:01000000:3.0:1783349733.305441:0:7799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349733.305445:0:7799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349733.305446:0:7799:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783349733.305450:0:7799:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1783349733.305816:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783349733.305837:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783349733.305847:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.305868:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349733.305878:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783349733.305880:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320c6fcb000 from 30 10000000:01000000:1.0:1783349733.305883:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783349733.305905:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.305912:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.305920:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349733.305933:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733696:0@lo:101: 00000100:00100000:1.0:1783349733.305962:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.305987:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14900 going to sleep for 11 seconds 00000100:00100000:2.0:1783349733.306001:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733696 00000100:00100000:2.0:1783349733.306007:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733696 00000100:00100000:2.0:1783349733.306054:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783349733.306063:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666733696:12345-0@lo:101: 00010000:00010000:2.0:1783349733.306073:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349733.306187:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476193 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.306212:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476193 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.306223:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476193 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.306232:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050c00, rc 0) 00000100:00100000:2.0:1783349733.306267:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666733696:12345-0@lo:101: Request processed in 206us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.306274:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783349733.306320:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733696:0@lo:101: 00010000:00010000:2.0:1783349733.306334:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.306343:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349733.306385:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733824:0@lo:501: 00000100:00100000:2.0:1783349733.306413:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.306432:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349733.306445:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733824 00000100:00100000:2.0:1783349733.306450:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733824 00000100:00100000:2.0:1783349733.306479:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783349733.306501:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666733824:12345-0@lo:501: 00000100:00100000:2.0:1783349733.307198:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666733824:12345-0@lo:501: Request processed in 710us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.307206:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783349733.307252:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733824:0@lo:501: 00000100:00100000:2.0:1783349733.307285:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733952:0@lo:503: 00000100:00100000:2.0:1783349733.307322:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.307346:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c87ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349733.307360:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666733952 00000100:00100000:2.0:1783349733.307364:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666733952 00000100:00100000:2.0:1783349733.307390:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783349733.307397:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666733952:12345-0@lo:503: 00000100:00100000:2.0:1783349733.307605:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666733952:12345-0@lo:503: Request processed in 207us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.307621:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783349733.307659:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666733952:0@lo:503: 00000100:00100000:2.0:1783349733.308041:0:7801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7801:1869977666734080:0@lo:502: 00000100:00100000:2.0:1783349733.308156:0:7801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.308178:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734080 00000100:00100000:2.0:1783349733.308182:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734080 00000100:00100000:2.0:1783349733.308205:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783349733.308212:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:7801:x1869977666734080:12345-0@lo:502: 00000100:00100000:2.0:1783349733.308380:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:7801:x1869977666734080:12345-0@lo:502: Request processed in 168us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.308387:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783349733.308425:0:7801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca1b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349733.308438:0:7801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7801:1869977666734080:0@lo:502: 00000100:00100000:2.0:1783349733.308481:0:7801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7801:1869977666734208:0@lo:502: 00000100:00100000:2.0:1783349733.308513:0:7801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.308598:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734208 00000100:00100000:2.0:1783349733.308602:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734208 00000100:00100000:2.0:1783349733.308624:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783349733.308630:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:7801:x1869977666734208:12345-0@lo:502: 00000100:00100000:2.0:1783349733.308753:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:7801:x1869977666734208:12345-0@lo:502: Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.308760:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783349733.308811:0:7801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca1b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349733.308824:0:7801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7801:1869977666734208:0@lo:502: 00000040:00080000:2.0:1783349733.308918:0:7801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783349733.308963:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783349733.308976:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349733.308985:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.308995:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349733.309004:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783349733.309006:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320c6fcb000 from 5 10000000:01000000:2.0:1783349733.309009:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783349733.309033:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.309053:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349733.309063:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349733.309076:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734336:0@lo:101: 00000100:00100000:2.0:1783349733.309169:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.309207:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca1b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.309348:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734336 00000100:00100000:1.0:1783349733.309354:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734336 00000100:00100000:1.0:1783349733.309434:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349733.309443:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666734336:12345-0@lo:101: 00010000:00010000:1.0:1783349733.309452:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349733.309470:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d7534e00/0x68b4a22a484761a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484761a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.309492:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d7534e00/0x68b4a22a484761a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484761a1 expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.309512:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d7534e00/0x68b4a22a484761a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484761a1 expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.309520:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d7534e00, rc 0) 00000100:00100000:1.0:1783349733.309555:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666734336:12345-0@lo:101: Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349733.309629:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783349733.309665:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c7259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734336:0@lo:101: 00010000:00010000:1.0:1783349733.309676:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.309685:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349733.309729:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734464:0@lo:256: 00000100:00100000:1.0:1783349733.309763:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.310151:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.310229:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734464 00000100:00100000:3.0:1783349733.310234:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734464 00000100:00100000:3.0:1783349733.310308:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783349733.310318:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666734464:12345-0@lo:256: 20000000:01000000:3.0:1783349733.310334:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783349733.310351:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783349733.310355:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783349733.310443:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666734464:12345-0@lo:256: Request processed in 127us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349733.310458:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783349733.310519:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734464:0@lo:256: 10000000:01000000:1.0:1783349733.310561:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783349733.310568:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.310577:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349733.310585:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783349733.310592:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1783349733.310595:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783349733.310615:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.310623:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.310630:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349733.310645:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734592:0@lo:101: 00000100:00100000:1.0:1783349733.310677:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.310745:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320cdf09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.310769:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734592 00000100:00100000:0.0:1783349733.310774:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734592 00000100:00100000:0.0:1783349733.310817:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783349733.310825:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666734592:12345-0@lo:101: 00010000:00010000:0.0:1783349733.310832:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349733.310842:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484761af expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.310859:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484761af expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.310869:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484761af expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.310876:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030400, rc 0) 00000100:00100000:0.0:1783349733.310910:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666734592:12345-0@lo:101: Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.310917:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783349733.310952:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734592:0@lo:101: 00010000:00010000:0.0:1783349733.310963:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349733.310972:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349733.311032:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734720:0@lo:501: 00000100:00100000:0.0:1783349733.311076:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.311095:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd665e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.311106:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734720 00000100:00100000:0.0:1783349733.311109:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734720 00000100:00100000:0.0:1783349733.311125:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783349733.311131:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666734720:12345-0@lo:501: 00000100:00100000:0.0:1783349733.311380:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666734720:12345-0@lo:501: Request processed in 248us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.311388:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783349733.311420:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734720:0@lo:501: 00000100:00100000:0.0:1783349733.311451:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734848:0@lo:503: 00000100:00100000:0.0:1783349733.311492:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.311507:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd665e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.311520:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734848 00000100:00100000:0.0:1783349733.311524:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734848 00000100:00100000:0.0:1783349733.311542:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783349733.311548:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666734848:12345-0@lo:503: 00000100:00100000:0.0:1783349733.311932:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666734848:12345-0@lo:503: Request processed in 382us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.311939:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783349733.311975:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666734848:0@lo:503: 00000100:00100000:0.0:1783349733.312145:0:7803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7803:1869977666734976:0@lo:502: 00000100:00100000:0.0:1783349733.312177:0:7803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.312204:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666734976 00000100:00100000:0.0:1783349733.312208:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666734976 00000100:00100000:0.0:1783349733.312225:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783349733.312231:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:7803:x1869977666734976:12345-0@lo:502: 00000100:00100000:0.0:1783349733.312500:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:7803:x1869977666734976:12345-0@lo:502: Request processed in 268us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349733.312508:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783349733.312544:0:7803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd665240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349733.312555:0:7803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7803:1869977666734976:0@lo:502: 00000020:01000000:0.0:1783349733.312574:0:7803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783349733.312581:0:7803:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783349733.312587:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349733.312589:0:7803:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783349733.312595:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783349733.312599:0:7803:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.136@tcp to nid 0x20000c0a8cc88 (192.168.204.136@tcp) 00000020:01000000:0.0:1783349733.312623:0:7803:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783349733.312627:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349733.312640:0:7803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9320f7d90000) 00000020:00000080:0.0:1783349733.312658:0:7803:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783349733.312664:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783349733.312752:0:7803:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783349733.312758:0:7803:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783349733.312766:0:7803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a484761c4 00010000:00080000:0.0:1783349733.312816:0:7803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff931fc7d58000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.136@tcp at head 00010000:00010000:0.0:1783349733.313037:0:7803:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1783349733.313480:0:7803:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1783349733.313494:0:7803:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783349733.314200:0:7803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349733.314399:0:7803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349733.314454:0:7803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1783349733.314511:0:7803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1783349733.320360:0:7804:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349733.320368:0:7804:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783349733.322350:0:7803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783349733.322362:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783349733.322397:0:7803:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783349733.322673:0:7803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484761cb 00000100:00080000:1.0:1783349733.322684:0:7803:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783349733.322690:0:7803:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff931fc7d58000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:1.0:1783349733.322725:0:7803:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320c4fc3100 x1869977666735104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349733.322783:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666735104:0@lo:8: 00000100:00100000:2.0:1783349733.323090:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.323237:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735104 00000100:00100000:3.0:1783349733.323245:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735104 00000100:00100000:3.0:1783349733.323277:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349733.323285:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1869977666735104:12345-0@lo:8: 00010000:00080000:3.0:1783349733.323308:0:6580:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:3.0:1783349733.323331:0:6580:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484761d2 00002000:00100000:3.0:1783349733.323343:0:6580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9320c86b6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783349733.323347:0:6580:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1783349733.323350:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783349733.323458:0:6580:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1783349733.323699:0:7803:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783349733.323785:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666735616:0@lo:400: 00000100:00100000:2.0:1783349733.323939:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666735232:0@lo:400: 00000100:00100000:2.0:1783349733.323976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.324010:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666735360:0@lo:400: 00000100:00100000:2.0:1783349733.324040:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.324069:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349733.324075:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666735488:0@lo:400: 00000100:00100000:2.0:1783349733.324097:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349733.324121:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735232 00000100:00100000:2.0:1783349733.324125:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735232 00000100:00100000:1.0:1783349733.324221:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783349733.324294:0:7803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349733.324300:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349733.324302:0:7803:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783349733.324305:0:7803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349733.324315:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349733.324316:0:7803:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783349733.324320:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783349733.324322:0:7803:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783349733.324342:0:7803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7803:1869977666735744:0@lo:502: 00000100:00100000:1.0:1783349733.324381:0:7803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.324401:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735744 00000100:00100000:1.0:1783349733.324405:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735744 00000100:00100000:1.0:1783349733.324427:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349733.324433:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:7803:x1869977666735744:12345-0@lo:502: 00000100:00100000:2.0:1783349733.324601:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735360 00000100:00100000:2.0:1783349733.324605:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735360 00000100:00100000:2.0:1783349733.324626:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735616 00000100:00100000:2.0:1783349733.324628:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735616 00000100:00100000:2.0:1783349733.324641:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349733.324646:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666735232:12345-0@lo:400: 00000100:00100000:2.0:1783349733.324689:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666735232:12345-0@lo:400: Request processed in 41us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.324695:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349733.324716:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349733.324721:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666735360:12345-0@lo:400: 00000100:00100000:2.0:1783349733.324747:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666735360:12345-0@lo:400: Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.324752:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783349733.324762:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783349733.324767:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666735616:12345-0@lo:400: 00000100:00100000:2.0:1783349733.324814:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666735616:12345-0@lo:400: Request processed in 46us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.324820:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:3.0:1783349733.325126:0:6580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1783349733.325219:0:6578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783349733.325226:0:6578:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1783349733.325245:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783349733.325279:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc3800 x1869977666735232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349733.325292:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666735232:0@lo:400: 00010000:00080000:2.0:1783349733.325321:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc3480 x1869977666735360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349733.325330:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666735360:0@lo:400: 00010000:00080000:2.0:1783349733.325353:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc2680 x1869977666735616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349733.325361:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666735616:0@lo:400: 00000100:00100000:2.0:1783349733.325489:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735488 00000100:00100000:2.0:1783349733.325494:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735488 00000100:00100000:2.0:1783349733.325523:0:6578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783349733.325746:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:7803:x1869977666735744:12345-0@lo:502: Request processed in 1311us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349733.325753:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349733.325810:0:7803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320cdf09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.325822:0:7803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:7803:1869977666735744:0@lo:502: 00000020:01000000:1.0:1783349733.325851:0:7803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349733.325857:0:7803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349733.325859:0:7803:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783349733.325863:0:7803:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1783349733.325914:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1783349733.325937:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783349733.325946:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.325956:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349733.325966:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783349733.325968:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9320c75e8000 from 1 10000000:01000000:1.0:1783349733.325975:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783349733.325997:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.326005:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.326014:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349733.326026:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666735872:0@lo:101: 00000100:00100000:1.0:1783349733.326064:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.326079:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320cdf09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.326090:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666735872 00000100:00100000:1.0:1783349733.326093:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666735872 00000100:00100000:1.0:1783349733.326111:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349733.326116:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666735872:12345-0@lo:101: 00010000:00010000:1.0:1783349733.326125:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349733.326135:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484761d9 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783349733.326234:0:6580:0:(import.c:65:import_set_state_nolock()) ffff9320c86b1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349733.326273:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1869977666735104:12345-0@lo:8: Request processed in 2989us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349733.326280:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349733.326293:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349733.326299:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666735488:12345-0@lo:400: 00000100:00100000:3.0:1783349733.326326:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666735488:12345-0@lo:400: Request processed in 28us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349733.326332:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783349733.326474:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783349733.326498:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc3100 x1869977666735104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349733.326507:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783349733.326514:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783349733.326588:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783349733.326595:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783349733.326597:0:3290:0:(import.c:65:import_set_state_nolock()) ffff931fc7d58000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783349733.326621:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783349733.326626:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666735104:0@lo:8: 00010000:00080000:2.0:1783349733.326656:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc2a00 x1869977666735488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349733.326665:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666735488:0@lo:400: 00010000:00010000:1.0:1783349733.327021:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.327032:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.327040:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d7535400, rc 0) 00000100:00100000:1.0:1783349733.327269:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666735872:12345-0@lo:101: Request processed in 1152us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349733.327284:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349733.327318:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666735872:0@lo:101: 00010000:00010000:1.0:1783349733.327330:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.327338:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349733.327378:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666736000:0@lo:501: 00000100:00100000:1.0:1783349733.327402:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.327422:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320cdf09f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.327433:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736000 00000100:00100000:1.0:1783349733.327437:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736000 00000004:00080000:0.0:1783349733.327438:0:7804:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783349733.327458:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783349733.327464:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666736000:12345-0@lo:501: 00000004:00080000:0.0:1783349733.327565:0:7804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 120389772576ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783349733.327674:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666736000:12345-0@lo:501: Request processed in 209us (270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783349733.327681:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783349733.327713:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666736000:0@lo:501: 10000000:01000000:1.0:1783349733.327732:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783349733.327738:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349733.327745:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349733.366480:0:7806:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783349733.366509:0:7806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736256:0@lo:7: 00000100:00100000:2.0:1783349733.366523:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666736128:0@lo:13: 00000100:00100000:2.0:1783349733.366587:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.366587:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349733.366643:0:7806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fd665480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.366707:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736256 00000100:00100000:3.0:1783349733.366714:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736256 00000100:00100000:3.0:1783349733.366775:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349733.366838:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736128 00000100:00100000:2.0:1783349733.366844:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736128 00000100:00100000:2.0:1783349733.366881:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349733.366889:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666736128:12345-0@lo:13: 00000100:00080000:3.0:1783349733.366894:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349733.366912:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7806:x1869977666736256:12345-0@lo:7: 00002000:00000024:2.0:1783349733.366920:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1783349733.366974:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666736128:12345-0@lo:13: Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.366982:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783349733.367290:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7183100 x1869977666736128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349733.367308:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666736128:0@lo:13: 00002000:00080000:3.0:1783349733.383372:0:6580:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783349733.383381:0:6580:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783349733.383908:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7806:x1869977666736256:12345-0@lo:7: Request processed in 17119us (17322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349733.383920:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783349733.383978:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7180a80 x1869977666736256/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783349749 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349733.383993:0:7806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736256:0@lo:7: 00000004:00080000:3.0:1783349733.384007:0:7806:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783349733.384616:0:7806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736384:0@lo:5: 00000100:00100000:3.0:1783349733.385170:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.385219:0:7806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4f82540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.385258:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736384 00000100:00100000:3.0:1783349733.385265:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736384 00000100:00100000:3.0:1783349733.385699:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349733.385710:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7806:x1869977666736384:12345-0@lo:5: 00002000:00080000:3.0:1783349733.385740:0:6579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1783349733.385744:0:6579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783349733.386087:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7806:x1869977666736384:12345-0@lo:5: Request processed in 379us (918us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783349733.386094:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783349733.386136:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7ae3b80 x1869977666736384/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349749 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349733.386152:0:7806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736384:0@lo:5: 00000004:00080000:3.0:1783349733.386164:0:7806:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783349733.386194:0:7806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736512:0@lo:700: 00000100:00100000:3.0:1783349733.386234:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.386259:0:7806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4f82540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.386304:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736512 00000100:00100000:3.0:1783349733.386309:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736512 00000100:00100000:3.0:1783349733.386339:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349733.386347:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7806:x1869977666736512:12345-0@lo:700: 00000100:00100000:3.0:1783349733.386375:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6587:1869977666736640:0@lo:700: 00000100:00100000:3.0:1783349733.386409:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349733.386435:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4f826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349733.387030:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736640 00000100:00100000:1.0:1783349733.387037:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736640 00000100:00100000:1.0:1783349733.387084:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349733.387093:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6587:x1869977666736640:12345-0@lo:700: 00000004:00080000:3.0:1783349733.397028:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1783349733.431913:0:5791:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783349733.437063:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6587:x1869977666736640:12345-0@lo:700: Request processed in 49965us (50645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349733.437078:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783349733.437098:0:6587:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7ae3800 x1869977666736640/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783349749 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349733.437117:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6587:1869977666736640:0@lo:700: 40000000:02000000:3.0:1783349733.437131:0:6587:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:02000400:0.0:1783349733.499325:0:7836:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:1.0:1783349733.502223:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1783349733.502244:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783349733.502259:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7806:x1869977666736512:12345-0@lo:700: Request processed in 115906us (116018us total) trans 0 rc 0/0 00010000:00080000:3.0:1783349733.502288:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7ae0e00 x1869977666736512/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783349749 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349733.502304:0:7806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736512:0@lo:700: 00000100:00100000:2.0:1783349733.502344:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:1.0:1783349733.528892:0:7806:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1783349733.536885:0:7806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736768:0@lo:5: 00000100:00100000:1.0:1783349733.536953:0:7806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349733.537061:0:7806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349733.537188:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736768 00000100:00100000:3.0:1783349733.537197:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736768 00000100:00100000:3.0:1783349733.537257:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349733.537268:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7806:x1869977666736768:12345-0@lo:5: 00002000:00080000:2.0:1783349733.543157:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783349733.543186:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783349733.547115:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7806:x1869977666736768:12345-0@lo:5: Request processed in 9843us (10155us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783349733.547125:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783349733.547353:0:7806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc1880 x1869977666736768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349749 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349733.547368:0:7806:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783349733.547388:0:7806:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9320c4fc1880 x1869977666736768/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783349749 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349733.547399:0:7806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7806:1869977666736768:0@lo:5: 00000004:00080000:1.0:1783349733.547412:0:7806:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1783349734.059195:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349735.081947:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349736.105896:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349736.811890:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666736896:0@lo:13: 00000100:00100000:1.0:1783349736.811987:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349736.812165:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666736896 00000100:00100000:1.0:1783349736.812173:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666736896 00000100:00100000:1.0:1783349736.812231:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349736.812241:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666736896:12345-0@lo:13: 00002000:00000024:1.0:1783349736.812275:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349736.812331:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666736896:12345-0@lo:13: Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349736.812338:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783349736.812360:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783349736.812392:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320c4fc0a80 x1869977666736896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349736.812410:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666736896:0@lo:13: 00000001:00080000:1.0:1783349736.938085:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1783349737.129943:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349737.254180:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.254555:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655181440 00000100:00100000:2.0:1783349737.254567:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655181440 00000100:00100000:2.0:1783349737.254614:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:2.0:1783349737.254623:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1869977655181440:12345-192.168.204.36@tcp:250: 00010000:00080000:2.0:1783349737.254649:0:5779:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8eaf26d6-4d34-43dd-a71e-1610389f65c9@192.168.204.36@tcp t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:2.0:1783349737.254678:0:5779:0:(genops.c:1406:class_connect()) connect: client 8eaf26d6-4d34-43dd-a71e-1610389f65c9, cookie 0x68b4a22a484761e7 00000100:00080000:0.0:1783349737.254899:0:5779:0:(import.c:65:import_set_state_nolock()) ffff931fc7b8f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349737.254964:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+5:2358:x1869977655181440:12345-192.168.204.36@tcp:250: Request processed in 341us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349737.254983:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1783349737.260154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349737.260202:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655181568 00000100:00100000:1.0:1783349737.260214:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655181568 00000100:00100000:1.0:1783349737.260468:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:1.0:1783349737.260478:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+5:5554:x1869977655181568:12345-192.168.204.36@tcp:101: 00010000:00010000:1.0:1783349737.260496:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349737.260513:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b863 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349737.260548:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349737.260561:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349737.260572:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d7534800, rc 0) 00000100:00100000:1.0:1783349737.260627:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+6:5554:x1869977655181568:12345-192.168.204.36@tcp:101: Request processed in 150us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349737.260647:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:0.0:1783349737.264102:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349737.264146:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655181696 00000100:00100000:0.0:1783349737.264156:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655181696 00000100:00100000:0.0:1783349737.264215:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 109 00000100:00100000:0.0:1783349737.264225:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+6:5554:x1869977655181696:12345-192.168.204.36@tcp:501: 00000100:00100000:0.0:1783349737.264687:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+6:5554:x1869977655181696:12345-192.168.204.36@tcp:501: Request processed in 463us (594us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349737.264696:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 109 00000100:00100000:1.0:1783349737.269664:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.269891:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655181824 00000100:00100000:2.0:1783349737.269901:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655181824 00000100:00100000:2.0:1783349737.269946:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 110 00000100:00100000:2.0:1783349737.269956:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+6:5554:x1869977655181824:12345-192.168.204.36@tcp:101: 00010000:00010000:2.0:1783349737.269982:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349737.270000:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b86a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349737.270028:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349737.270039:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349737.270048:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102051c00, rc 0) 00000100:00100000:2.0:1783349737.270112:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+7:5554:x1869977655181824:12345-192.168.204.36@tcp:101: Request processed in 158us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.270119:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 110 00000100:00100000:1.0:1783349737.272505:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349737.272596:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655181952 00000100:00100000:0.0:1783349737.272604:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655181952 00000100:00100000:0.0:1783349737.272665:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 111 00000100:00100000:0.0:1783349737.272675:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+7:5554:x1869977655181952:12345-192.168.204.36@tcp:501: 00000100:00100000:0.0:1783349737.272935:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5554:x1869977655181952:12345-192.168.204.36@tcp:501: Request processed in 260us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349737.272943:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 111 00000100:00100000:1.0:1783349737.276603:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.276779:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182080 00000100:00100000:2.0:1783349737.276788:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182080 00000100:00100000:2.0:1783349737.276852:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 112 00000100:00100000:2.0:1783349737.276862:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5554:x1869977655182080:12345-192.168.204.36@tcp:503: 00000100:00100000:2.0:1783349737.277750:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5554:x1869977655182080:12345-192.168.204.36@tcp:503: Request processed in 885us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.277760:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 112 00000100:00100000:1.0:1783349737.282247:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349737.282937:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182208 00000100:00100000:3.0:1783349737.282947:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182208 00000100:00100000:3.0:1783349737.283004:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 113 00000100:00100000:3.0:1783349737.283014:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5572:x1869977655182208:12345-192.168.204.36@tcp:502: 00000100:00100000:3.0:1783349737.284022:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5572:x1869977655182208:12345-192.168.204.36@tcp:502: Request processed in 1007us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349737.284035:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 113 00000100:00100000:1.0:1783349737.300350:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349737.300408:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182336 00000100:00100000:3.0:1783349737.300420:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182336 00000100:00100000:3.0:1783349737.300479:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:3.0:1783349737.300489:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5572:x1869977655182336:12345-192.168.204.36@tcp:502: 00000100:00100000:3.0:1783349737.300735:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5572:x1869977655182336:12345-192.168.204.36@tcp:502: Request processed in 247us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349737.300744:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:0.0:1783349737.306342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349737.307432:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182464 00000100:00100000:3.0:1783349737.307443:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182464 00000100:00100000:3.0:1783349737.307515:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 115 00000100:00100000:3.0:1783349737.307524:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5554:x1869977655182464:12345-192.168.204.36@tcp:101: 00010000:00010000:3.0:1783349737.307540:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349737.307556:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9003200/0x68b4a22a484761fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b894 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349737.307582:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9003200/0x68b4a22a484761fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b894 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349737.307594:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9003200/0x68b4a22a484761fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b894 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349737.307603:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003200, rc 0) 00000100:00100000:3.0:1783349737.307663:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5554:x1869977655182464:12345-192.168.204.36@tcp:101: Request processed in 138us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349737.307684:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 115 00000100:00100000:3.0:1783349737.311998:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349737.312084:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182592 00000100:00100000:1.0:1783349737.312096:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182592 00000100:00100000:1.0:1783349737.312187:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 116 00000100:00100000:1.0:1783349737.312201:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5554:x1869977655182592:12345-192.168.204.36@tcp:256: 20000000:01000000:1.0:1783349737.312228:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783349737.312248:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783349737.312252:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783349737.312255:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783349737.312257:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1783349737.317275:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5554:x1869977655182592:12345-192.168.204.36@tcp:256: Request processed in 5065us (5274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.317292:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 116 00000100:00100000:1.0:1783349737.322218:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.322275:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182720 00000100:00100000:2.0:1783349737.322286:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182720 00000100:00100000:2.0:1783349737.322341:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 117 00000100:00100000:2.0:1783349737.322350:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5554:x1869977655182720:12345-192.168.204.36@tcp:101: 00010000:00010000:2.0:1783349737.322367:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349737.322386:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b89b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349737.322414:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349737.322426:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349737.322445:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050600, rc 0) 00000100:00100000:2.0:1783349737.322501:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5554:x1869977655182720:12345-192.168.204.36@tcp:101: Request processed in 152us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.322509:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 117 00000100:00100000:1.0:1783349737.324446:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.324691:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182848 00000100:00100000:2.0:1783349737.324702:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182848 00000100:00100000:2.0:1783349737.324766:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 118 00000100:00100000:2.0:1783349737.324777:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5554:x1869977655182848:12345-192.168.204.36@tcp:501: 00000100:00100000:2.0:1783349737.325069:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5554:x1869977655182848:12345-192.168.204.36@tcp:501: Request processed in 292us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.325078:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 118 00000100:00100000:2.0:1783349737.327475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349737.327545:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655182976 00000100:00100000:1.0:1783349737.327555:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655182976 00000100:00100000:1.0:1783349737.327604:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 119 00000100:00100000:1.0:1783349737.327613:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5554:x1869977655182976:12345-192.168.204.36@tcp:503: 00000100:00100000:1.0:1783349737.327991:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5554:x1869977655182976:12345-192.168.204.36@tcp:503: Request processed in 377us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349737.327999:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 119 00000100:00100000:1.0:1783349737.331181:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.333371:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183104 00000100:00100000:2.0:1783349737.333383:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183104 00000100:00100000:2.0:1783349737.333439:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:2.0:1783349737.333447:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5577:x1869977655183104:12345-192.168.204.36@tcp:502: 00000100:00100000:2.0:1783349737.333725:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5577:x1869977655183104:12345-192.168.204.36@tcp:502: Request processed in 276us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.333734:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:3.0:1783349737.336343:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.336379:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183232 00000100:00100000:2.0:1783349737.336388:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183232 00000100:00100000:2.0:1783349737.336437:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 121 00000100:00100000:2.0:1783349737.336446:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5577:x1869977655183232:12345-192.168.204.36@tcp:502: 00000100:00100000:2.0:1783349737.336722:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5577:x1869977655183232:12345-192.168.204.36@tcp:502: Request processed in 276us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.336730:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 121 00000100:00100000:3.0:1783349737.340364:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349737.340414:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183360 00000100:00100000:2.0:1783349737.340423:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183360 00000100:00100000:2.0:1783349737.340533:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:2.0:1783349737.340541:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1869977655183360:12345-192.168.204.36@tcp:38: 00010000:00080000:2.0:1783349737.340567:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:2.0:1783349737.340612:0:5786:0:(genops.c:1406:class_connect()) connect: client ed421ea5-67f7-4096-abd5-85a5a23dfd60, cookie 0x68b4a22a4847620a 00000004:00100000:2.0:1783349737.340650:0:5786:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783349737.340669:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1783349737.361974:0:5786:0:(import.c:65:import_set_state_nolock()) ffff931fc7b88000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349737.362100:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2358:x1869977655183360:12345-192.168.204.36@tcp:38: Request processed in 21557us (21744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349737.362111:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00010000:00010000:0.0:1783349738.154421:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349738.346396:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666737152:0@lo:400: 00000100:00100000:0.0:1783349738.346398:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666737280:0@lo:400: 00000100:00100000:1.0:1783349738.346459:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666737024:0@lo:400: 00000100:00100000:3.0:1783349738.346540:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666737408:0@lo:400: 00000100:00100000:0.0:1783349738.347040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349738.347101:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737280 00000100:00100000:0.0:1783349738.347108:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737280 00000100:00100000:0.0:1783349738.347203:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783349738.347214:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666737280:12345-0@lo:400: 00000100:00100000:0.0:1783349738.347260:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666737280:12345-0@lo:400: Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349738.347266:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783349738.347295:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7181f80 x1869977666737280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349738.347306:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666737280:0@lo:400: 00000100:00080000:0.0:1783349738.347325:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349738.350189:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349738.350248:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666737664:0@lo:400: 00000100:00100000:2.0:1783349738.350286:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349738.350364:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737664 00000100:00100000:2.0:1783349738.350371:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737664 00000100:00100000:2.0:1783349738.350423:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349738.350430:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666737664:12345-0@lo:400: 00000100:00100000:2.0:1783349738.350478:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666737664:12345-0@lo:400: Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349738.350485:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783349738.350503:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783349738.350527:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7180700 x1869977666737664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349738.350537:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783349738.350555:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666737664:0@lo:400: 00000100:00100000:0.0:1783349738.350654:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737152 00000100:00100000:0.0:1783349738.350659:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737152 00000100:00100000:0.0:1783349738.350692:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349738.350699:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666737152:12345-0@lo:400: 00000100:00100000:0.0:1783349738.350736:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666737152:12345-0@lo:400: Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349738.350757:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783349738.350832:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7181500 x1869977666737152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349738.350841:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666737152:0@lo:400: 00000100:00100000:1.0:1783349738.353222:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349738.353283:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666737536:0@lo:400: 00000100:00100000:1.0:1783349738.353317:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349738.353396:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349738.353444:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737408 00000100:00100000:1.0:1783349738.353452:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737408 00000100:00100000:1.0:1783349738.353517:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349738.353525:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666737408:12345-0@lo:400: 00000100:00100000:1.0:1783349738.353602:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666737408:12345-0@lo:400: Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349738.353609:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783349738.353643:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783349738.353672:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7182680 x1869977666737408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349738.353736:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666737408:0@lo:400: 00000100:00100000:2.0:1783349738.354021:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737024 00000100:00100000:2.0:1783349738.354038:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737024 00000100:00100000:2.0:1783349738.354080:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783349738.354088:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666737024:12345-0@lo:400: 00000100:00100000:2.0:1783349738.354135:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666737024:12345-0@lo:400: Request processed in 49us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349738.354142:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783349738.354179:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666737024:0@lo:400: 00000100:00100000:0.0:1783349738.354386:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737536 00000100:00100000:0.0:1783349738.354391:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737536 00000100:00080000:3.0:1783349738.354442:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349738.354490:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783349738.354499:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666737536:12345-0@lo:400: 00000100:00100000:0.0:1783349738.354556:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666737536:12345-0@lo:400: Request processed in 59us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349738.354562:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783349738.354633:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7180380 x1869977666737536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349738.354644:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666737536:0@lo:400: 00000100:00100000:1.0:1783349738.368021:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349738.368186:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349738.368354:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183488 00000100:00100000:0.0:1783349738.368368:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183488 00000100:00080000:3.0:1783349738.368518:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349738.368642:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183616 00000100:00100000:0.0:1783349738.368646:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183616 00000100:00100000:2.0:1783349738.368685:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:2.0:1783349738.368697:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:0:x1869977655183488:12345-192.168.204.36@tcp:41: 00000004:00000024:2.0:1783349738.368753:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783349738.368857:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:1.0:1783349738.368866:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:5554:x1869977655183616:12345-192.168.204.36@tcp:41: 00000004:00000024:1.0:1783349738.368883:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783349738.368987:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:5554:x1869977655183616:12345-192.168.204.36@tcp:41: Request processed in 122us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349738.369000:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:2.0:1783349738.369013:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:0:x1869977655183488:12345-192.168.204.36@tcp:41: Request processed in 303us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349738.369028:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349738.372144:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349738.372412:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183744 00000100:00100000:1.0:1783349738.372434:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183744 00000100:00100000:1.0:1783349738.372515:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:1.0:1783349738.372527:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5554:x1869977655183744:12345-192.168.204.36@tcp:40: 00000100:00100000:1.0:1783349738.372646:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5554:x1869977655183744:12345-192.168.204.36@tcp:40: Request processed in 120us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349738.372655:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:3.0:1783349738.377342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349738.377639:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655183872 00000100:00100000:2.0:1783349738.377652:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655183872 00000100:00100000:2.0:1783349738.377706:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:2.0:1783349738.377716:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1869977655183872:12345-192.168.204.36@tcp:8: 00010000:00080000:2.0:1783349738.377762:0:6579:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp t0 exp 0000000000000000 cur 125 last 0 00000020:00000080:2.0:1783349738.377836:0:6579:0:(genops.c:1406:class_connect()) connect: client ed421ea5-67f7-4096-abd5-85a5a23dfd60, cookie 0x68b4a22a48476211 00002000:00100000:2.0:1783349738.377851:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed421ea5-67f7-4096-abd5-85a5a23dfd60/ffff931fc7b8a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783349738.377882:0:6579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783349738.378288:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783349738.378327:0:6579:0:(import.c:65:import_set_state_nolock()) ffff931fc7b8c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349738.378492:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2358:x1869977655183872:12345-192.168.204.36@tcp:8: Request processed in 775us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349738.378500:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:1.0:1783349738.383104:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349738.383181:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184128 00000100:00100000:3.0:1783349738.383195:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184128 00000100:00100000:3.0:1783349738.383267:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 123 00000100:00100000:3.0:1783349738.383280:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655184128:12345-192.168.204.36@tcp:400: 00000100:00100000:1.0:1783349738.384996:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349738.385064:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349738.385151:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184000 00000100:00100000:0.0:1783349738.385162:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184000 00000100:00100000:2.0:1783349738.385200:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184256 00000100:00100000:2.0:1783349738.385206:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184256 00000100:00100000:0.0:1783349738.385218:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:0.0:1783349738.385229:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1869977655184000:12345-192.168.204.36@tcp:8: 00000100:00100000:2.0:1783349738.385246:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:2.0:1783349738.385255:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5554:x1869977655184256:12345-192.168.204.36@tcp:33: 00010000:00080000:0.0:1783349738.385271:0:6580:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp t0 exp 0000000000000000 cur 125 last 0 00000020:00000080:0.0:1783349738.385313:0:6580:0:(genops.c:1406:class_connect()) connect: client ed421ea5-67f7-4096-abd5-85a5a23dfd60, cookie 0x68b4a22a48476218 00002000:00100000:0.0:1783349738.385329:0:6580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed421ea5-67f7-4096-abd5-85a5a23dfd60/ffff931fc7d5d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783349738.385481:0:6580:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783349738.386229:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655184128:12345-192.168.204.36@tcp:400: Request processed in 2942us (3357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349738.386245:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 123 00002000:00080000:0.0:1783349738.386606:0:6580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783349738.386651:0:6580:0:(import.c:65:import_set_state_nolock()) ffff931fc7d5e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349738.386722:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2358:x1869977655184000:12345-192.168.204.36@tcp:8: Request processed in 1493us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349738.386731:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000004:00080000:3.0:1783349738.401494:0:5787:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15950us 00000004:00200000:3.0:1783349738.414252:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783349738.415178:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5554:x1869977655184256:12345-192.168.204.36@tcp:33: Request processed in 29913us (30180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349738.415197:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:1.0:1783349738.526563:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349738.526682:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184384 00000100:00100000:0.0:1783349738.526713:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184384 00000100:00100000:0.0:1783349738.526843:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:0.0:1783349738.526856:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5594:x1869977655184384:12345-192.168.204.36@tcp:101: 00010000:00010000:0.0:1783349738.526884:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349738.527066:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031200/0x68b4a22a4847621f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b8c5 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349738.527146:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a48476226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349738.527160:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a48476226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349738.527176:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a48476226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349738.527675:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783349738.527681:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349738.527765:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a48476226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349738.527838:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031200/0x68b4a22a4847621f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8c5 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349738.527859:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a48476226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8c5 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349738.527868:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349738.527871:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349738.527874:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030600, rc 0) 00000100:00100000:0.0:1783349738.527960:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:5594:x1869977655184384:12345-192.168.204.36@tcp:101: Request processed in 1107us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349738.527970:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:0.0:1783349738.858185:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666737792:0@lo:13: 00000100:00100000:0.0:1783349738.858283:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349738.858354:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737792 00000100:00100000:1.0:1783349738.858365:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737792 00000100:00100000:1.0:1783349738.858609:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783349738.858621:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666737792:12345-0@lo:13: 00002000:00000024:1.0:1783349738.858651:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349738.858726:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666737792:12345-0@lo:13: Request processed in 107us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349738.858734:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783349738.859012:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7181f80 x1869977666737792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349738.859036:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666737792:0@lo:13: 00010000:00010000:0.0:1783349739.178225:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349740.202080:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349740.219009:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349740.219448:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184512 00000100:00100000:1.0:1783349740.219751:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184512 00000100:00100000:1.0:1783349740.219963:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:1.0:1783349740.219977:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:5647:x1869977655184512:12345-192.168.204.36@tcp:41: 00000004:00000024:1.0:1783349740.220022:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783349740.220107:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:5647:x1869977655184512:12345-192.168.204.36@tcp:41: Request processed in 133us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349740.220115:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00080000:3.0:1783349740.220776:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349740.227953:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349740.228055:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184640 00000100:00100000:2.0:1783349740.228065:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184640 00000100:00100000:2.0:1783349740.228156:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00080000:3.0:1783349740.228158:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349740.228170:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5647:x1869977655184640:12345-192.168.204.36@tcp:13: 00002000:00000024:2.0:1783349740.228216:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349740.228292:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5647:x1869977655184640:12345-192.168.204.36@tcp:13: Request processed in 127us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349740.228299:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:2.0:1783349740.231148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349740.231274:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184768 00000100:00100000:1.0:1783349740.231288:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184768 00000100:00100000:1.0:1783349740.231448:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:1.0:1783349740.231459:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5647:x1869977655184768:12345-192.168.204.36@tcp:13: 00002000:00000024:1.0:1783349740.231500:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349740.231576:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:5647:x1869977655184768:12345-192.168.204.36@tcp:13: Request processed in 120us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349740.231595:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00080000:3.0:1783349740.232473:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783349741.225965:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349741.693244:0:8138:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783349741.930395:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666737920:0@lo:13: 00000100:00100000:3.0:1783349741.930459:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349741.930785:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666737920 00000100:00100000:2.0:1783349741.930843:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666737920 00000100:00100000:2.0:1783349741.930949:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349741.930958:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666737920:12345-0@lo:13: 00002000:00000024:2.0:1783349741.930980:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783349741.931034:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349741.931037:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666737920:12345-0@lo:13: Request processed in 81us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349741.931045:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783349741.931125:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a13800 x1869977666737920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349741.931139:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666737920:0@lo:13: 00010000:00010000:0.0:1783349742.250090:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783349742.474259:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000001:00100000:2.0:1783349742.482100:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000001:00100000:3.0:1783349742.483738:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00010000:00010000:3.0:1783349743.275656:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349743.466372:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666738176:0@lo:400: 00000100:00100000:2.0:1783349743.466478:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349743.466512:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666738432:0@lo:400: 00000100:00100000:1.0:1783349743.466552:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349743.466561:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666738688:0@lo:400: 00000100:00100000:1.0:1783349743.466588:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783349743.466596:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666738048:0@lo:400: 00000100:00100000:2.0:1783349743.466604:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349743.466640:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349743.466643:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349743.466650:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666738304:0@lo:400: 00000100:00100000:2.0:1783349743.466674:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349743.466834:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738432 00000100:00100000:3.0:1783349743.466843:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738432 00000100:00100000:3.0:1783349743.466903:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738688 00000100:00100000:3.0:1783349743.466907:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738688 00000100:00100000:3.0:1783349743.466927:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349743.466935:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666738432:12345-0@lo:400: 00000100:00100000:3.0:1783349743.466989:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666738432:12345-0@lo:400: Request processed in 54us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349743.466996:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349743.467010:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349743.467016:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666738688:12345-0@lo:400: 00000100:00100000:3.0:1783349743.467051:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666738688:12345-0@lo:400: Request processed in 35us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349743.467057:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783349743.467065:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349743.467071:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349743.467650:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738176 00000100:00100000:2.0:1783349743.467656:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738176 00000100:00100000:2.0:1783349743.467687:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738304 00000100:00100000:2.0:1783349743.467690:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738304 00000100:00100000:2.0:1783349743.467737:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349743.467746:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666738176:12345-0@lo:400: 00000100:00100000:1.0:1783349743.467820:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666738560:0@lo:400: 00000100:00100000:2.0:1783349743.467822:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666738176:12345-0@lo:400: Request processed in 75us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349743.467834:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349743.467865:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349743.467878:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349743.467879:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666738304:12345-0@lo:400: 00010000:00080000:1.0:1783349743.467912:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a10380 x1869977666738432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349743.468276:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666738432:0@lo:400: 00000100:00100000:2.0:1783349743.468278:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666738304:12345-0@lo:400: Request processed in 51us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349743.468289:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349743.468307:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738560 00000100:00100000:2.0:1783349743.468311:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738560 00000100:00100000:2.0:1783349743.468333:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783349743.468339:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666738560:12345-0@lo:400: 00000100:00100000:2.0:1783349743.468380:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666738560:12345-0@lo:400: Request processed in 41us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349743.468386:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783349743.468417:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349743.468455:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666738304:0@lo:400: 00010000:00080000:2.0:1783349743.468469:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a11180 x1869977666738688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349743.468479:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666738688:0@lo:400: 00000100:00100000:1.0:1783349743.468490:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666738560:0@lo:400: 00000100:00100000:2.0:1783349743.468499:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666738176:0@lo:400: 00000100:00100000:0.0:1783349743.468788:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738048 00000100:00100000:0.0:1783349743.468818:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738048 00000100:00100000:0.0:1783349743.468846:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783349743.468864:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666738048:12345-0@lo:400: 00000100:00100000:0.0:1783349743.469045:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666738048:12345-0@lo:400: Request processed in 181us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349743.469052:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783349743.469113:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666738048:0@lo:400: 00000100:00100000:0.0:1783349743.712645:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349743.712690:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349743.712710:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349743.712747:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349743.712773:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185024 00000100:00100000:0.0:1783349743.712783:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185024 00000100:00100000:0.0:1783349743.712882:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:0.0:1783349743.712892:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655185024:12345-192.168.204.36@tcp:400: 00000100:00100000:3.0:1783349743.713041:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655184896 00000100:00100000:3.0:1783349743.713046:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655184896 00000100:00100000:3.0:1783349743.713088:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:3.0:1783349743.713096:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2361:x1869977655184896:12345-192.168.204.36@tcp:400: 00000100:00100000:0.0:1783349743.713151:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655185024:12345-192.168.204.36@tcp:400: Request processed in 260us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349743.713159:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00080000:0.0:1783349743.713183:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349743.713530:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185152 00000100:00100000:2.0:1783349743.713536:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185152 00000100:00100000:2.0:1783349743.713574:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185280 00000100:00100000:2.0:1783349743.713577:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185280 00000100:00100000:2.0:1783349743.713601:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:2.0:1783349743.713608:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655185152:12345-192.168.204.36@tcp:400: 00000100:00100000:3.0:1783349743.714567:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2361:x1869977655184896:12345-192.168.204.36@tcp:400: Request processed in 1467us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349743.714579:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:3.0:1783349743.714638:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:3.0:1783349743.714646:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655185280:12345-192.168.204.36@tcp:400: 00000100:00100000:3.0:1783349743.714681:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655185280:12345-192.168.204.36@tcp:400: Request processed in 36us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349743.714688:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00080000:0.0:1783349743.714878:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349743.714882:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349743.715101:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655185152:12345-192.168.204.36@tcp:400: Request processed in 1492us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349743.715110:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:1.0:1783349743.978101:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666738816:0@lo:13: 00000100:00100000:1.0:1783349743.978169:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349743.978282:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666738816 00000100:00100000:3.0:1783349743.978291:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666738816 00000100:00100000:3.0:1783349743.978350:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349743.978359:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666738816:12345-0@lo:13: 00002000:00000024:3.0:1783349743.978450:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349743.978511:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666738816:12345-0@lo:13: Request processed in 153us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349743.978519:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783349743.978709:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7180e00 x1869977666738816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349743.978729:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666738816:0@lo:13: 00000020:00000080:2.0:1783349744.103182:0:8290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7dd6be10 20000000:00000080:2.0:1783349744.103198:0:8290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931fc6c24c00 uarg=0000000000000000 20000000:01000000:2.0:1783349744.103482:0:8290:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783349744.103485:0:8290:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783349744.103487:0:8290:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783349744.103492:0:8290:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783349744.103497:0:8290:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783349744.103509:0:8290:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783349744.103511:0:8290:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783349744.103881:0:8290:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783349744.103884:0:8290:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783349744.104513:0:8291:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783349744.105155:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783349744.105213:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783349744.105255:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1783349744.105266:0:8290:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783349744.105268:0:8290:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783349744.106009:0:8292:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783349744.106341:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783349744.106394:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783349744.106427:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1783349744.106436:0:8290:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783349744.106438:0:8290:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783349744.107297:0:8293:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1783349744.107754:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1783349744.107847:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1783349744.107899:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1783349744.107911:0:8290:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783349744.107913:0:8290:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783349744.108448:0:8294:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1783349744.108904:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1783349744.108947:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1783349744.108977:0:8290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1783349744.108990:0:8290:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783349744.109009:0:8290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109026:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476123 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109034:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847614d expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109041:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476177 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109047:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476185 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109053:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476193 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109059:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484761af expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109075:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109083:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109089:0:8290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109096:0:8290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109141:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109155:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 9 pid: 5777 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.109169:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666738944:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349744.109263:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109271:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.109279:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739072:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349744.109304:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109323:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 18 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.109333:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739200:0@lo:104: 00000100:00100000:2.0:1783349744.109368:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349744.109398:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484761af expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109405:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484761af expref: 18 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.109412:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739328:0@lo:104: 00000100:00100000:2.0:1783349744.109431:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349744.109449:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476193 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109456:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476193 expref: 18 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.109464:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739456:0@lo:104: 00010000:00010000:2.0:1783349744.109482:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476185 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109489:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476185 expref: 18 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.109496:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739584:0@lo:104: 00010000:00010000:2.0:1783349744.109513:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476177 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.109525:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476177 expref: 18 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.109848:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783349744.109866:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.109876:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.109884:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739200 00000100:00100000:1.0:1783349744.109891:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739200 00000100:00100000:1.0:1783349744.109922:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739328 00000100:00100000:1.0:1783349744.109924:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739328 00000100:00100000:1.0:1783349744.109934:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739456 00000100:00100000:1.0:1783349744.109936:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739456 00000100:00100000:1.0:1783349744.109944:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739584 00000100:00100000:1.0:1783349744.109946:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739584 00000100:00100000:1.0:1783349744.109967:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349744.109974:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:8290:x1869977666739200:12345-0@lo:104: 00010000:00010000:1.0:1783349744.109986:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110030:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349744.110035:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+6:8290:x1869977666739200:12345-0@lo:104: Request processed in 62us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.110041:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349744.110056:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349744.110061:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc469a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:8290:x1869977666739328:12345-0@lo:104: 00010000:00010000:1.0:1783349744.110067:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110093:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783349744.110097:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc469a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:8290:x1869977666739328:12345-0@lo:104: Request processed in 37us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.110103:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349744.110132:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349744.110137:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:8290:x1869977666739456:12345-0@lo:104: 00010000:00010000:1.0:1783349744.110143:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110169:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783349744.110173:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:8290:x1869977666739456:12345-0@lo:104: Request processed in 37us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.110178:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349744.110187:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349744.110198:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:8290:x1869977666739584:12345-0@lo:104: 00010000:00010000:1.0:1783349744.110205:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110227:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783349744.110231:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:8290:x1869977666739584:12345-0@lo:104: Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.110236:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1783349744.110251:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783349744.110256:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110263:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7534000 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.110267:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110274:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349744.110280:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.110285:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.110314:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110320:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.110337:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110353:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7534000/0x68b4a22a484761d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484761e0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110366:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783349744.110369:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110374:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7534a00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.110378:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110384:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349744.110390:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.110395:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.110405:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110410:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.110414:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110420:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7534a00/0x68b4a22a484761af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484761b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110427:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349744.110434:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110439:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7535200 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.110442:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110448:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349744.110453:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.110458:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.110467:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110473:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.110485:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110490:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7535200/0x68b4a22a48476193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847619a expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110499:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349744.110502:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110507:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.110509:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.110523:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.111784:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739712:0@lo:104: 00000100:00100000:2.0:1783349744.111875:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349744.111919:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a4847614d expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.111930:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a4847614d expref: 18 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.111940:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666740224:0@lo:104: 00000100:00100000:2.0:1783349744.111958:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349744.111977:0:8290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476123 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349744.111985:0:8290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476123 expref: 18 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.111993:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666740352:0@lo:104: 00000100:00100000:2.0:1783349744.112010:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349744.112018:0:8290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349744.112036:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739200:0@lo:104: 00000100:00100000:2.0:1783349744.112044:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739328:0@lo:104: 00000100:00100000:2.0:1783349744.112052:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739456:0@lo:104: 00000100:00100000:2.0:1783349744.112059:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739584:0@lo:104: 10000000:00010000:1.0:1783349744.112116:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.112126:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.112156:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.112162:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.112170:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.112176:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c0030c00/0x68b4a22a48476185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847618c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.112188:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.112189:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.112191:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.112197:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.112202:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349744.112212:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666739840:0@lo:103: 00000100:00100000:1.0:1783349744.112237:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.112261:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349744.112266:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666739968:0@lo:103: 00000100:00100000:1.0:1783349744.112283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.112305:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666740096:0@lo:103: 00000100:00100000:1.0:1783349744.112335:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.112349:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349744.112353:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666740480:0@lo:103: 00000100:00100000:1.0:1783349744.112370:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.112391:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739840 00000100:00100000:1.0:1783349744.112396:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739840 00010000:00010000:1.0:1783349744.112416:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 19 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.112433:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739968 00000100:00100000:1.0:1783349744.112435:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739968 00010000:00010000:1.0:1783349744.112442:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484761af expref: 20 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.112450:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740096 00000100:00100000:1.0:1783349744.112452:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740096 00010000:00010000:1.0:1783349744.112459:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476193 expref: 21 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.112467:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740480 00000100:00100000:1.0:1783349744.112469:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740480 00010000:00010000:1.0:1783349744.112476:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476185 expref: 22 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.112487:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349744.112493:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+22:3291:x1869977666739840:12345-0@lo:103: 00010000:00010000:1.0:1783349744.112504:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.112509:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 22 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.112516:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 22 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113308:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d7535400/0x68b4a22a484761e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484761d9 expref: 22 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113323:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.113360:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+21:3291:x1869977666739840:12345-0@lo:103: Request processed in 866us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.113367:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349744.113386:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349744.113392:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:3291:x1869977666739968:12345-0@lo:103: 00010000:00010000:1.0:1783349744.113400:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.113404:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484761af expref: 20 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113412:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484761af expref: 20 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113420:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030400/0x68b4a22a484761b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484761af expref: 20 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113428:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.113445:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666739968:12345-0@lo:103: Request processed in 54us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.113450:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349744.113460:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349744.113465:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:3293:x1869977666740096:12345-0@lo:103: 00010000:00010000:1.0:1783349744.113471:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.113476:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476193 expref: 18 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113489:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476193 expref: 18 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113498:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050c00/0x68b4a22a4847619a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476193 expref: 18 pid: 5778 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113507:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.113528:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3293:x1869977666740096:12345-0@lo:103: Request processed in 64us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.113547:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349744.113559:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349744.113564:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3293:x1869977666740480:12345-0@lo:103: 00010000:00010000:1.0:1783349744.113571:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.113575:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476185 expref: 16 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113583:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476185 expref: 16 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113592:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847618c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476185 expref: 16 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.113600:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.113619:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:3293:x1869977666740480:12345-0@lo:103: Request processed in 54us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.113625:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349744.113668:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666739968:0@lo:103: 00000100:00100000:1.0:1783349744.113676:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666739840:0@lo:103: 00000100:00100000:1.0:1783349744.113712:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666740480:0@lo:103: 00000100:00100000:1.0:1783349744.113719:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666740096:0@lo:103: 00000100:00100000:1.0:1783349744.113736:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666739712 00000100:00100000:1.0:1783349744.113740:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666739712 00000100:00100000:1.0:1783349744.113757:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740224 00000100:00100000:1.0:1783349744.113759:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740224 00000100:00100000:1.0:1783349744.113766:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740352 00000100:00100000:1.0:1783349744.113769:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740352 00000100:00100000:1.0:1783349744.113778:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349744.113809:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:8290:x1869977666739712:12345-0@lo:104: 00010000:00010000:1.0:1783349744.113818:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114048:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349744.114053:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:8290:x1869977666739712:12345-0@lo:104: Request processed in 245us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.114059:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349744.114070:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349744.114074:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:8290:x1869977666740224:12345-0@lo:104: 00010000:00010000:1.0:1783349744.114081:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114108:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783349744.114112:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:8290:x1869977666740224:12345-0@lo:104: Request processed in 38us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.114117:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349744.114126:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349744.114138:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:8290:x1869977666740352:12345-0@lo:104: 00010000:00010000:1.0:1783349744.114145:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114172:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783349744.114176:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:8290:x1869977666740352:12345-0@lo:104: Request processed in 39us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.114180:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1783349744.114194:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783349744.114199:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114205:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002e00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.114209:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114215:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349744.114222:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.114227:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.114243:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114249:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.114261:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114276:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9002e00/0x68b4a22a48476177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847617e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114286:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349744.114289:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114294:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7535e00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.114297:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114303:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349744.114309:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.114313:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.114324:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114330:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.114334:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114341:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7535e00/0x68b4a22a4847614d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476154 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114349:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349744.114357:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114363:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7535c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349744.114366:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114373:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349744.114379:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349744.114384:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783349744.114393:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114399:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349744.114409:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114415:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7535c00/0x68b4a22a48476123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847612a expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114426:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.114428:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.114430:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349744.114434:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349744.114443:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666740608:0@lo:103: 00000100:00100000:1.0:1783349744.114469:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.114494:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349744.114505:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666740736:0@lo:103: 00000100:00100000:1.0:1783349744.114524:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.114543:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666740864:0@lo:103: 00000100:00100000:1.0:1783349744.114566:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349744.114587:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740608 00000100:00100000:1.0:1783349744.114591:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740608 00010000:00010000:1.0:1783349744.114606:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476177 expref: 15 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.114617:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740736 00000100:00100000:1.0:1783349744.114619:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740736 00010000:00010000:1.0:1783349744.114627:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847614d expref: 16 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.114636:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740864 00000100:00100000:1.0:1783349744.114638:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740864 00010000:00010000:1.0:1783349744.114646:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476123 expref: 17 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.114656:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349744.114661:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3291:x1869977666740608:12345-0@lo:103: 00010000:00010000:1.0:1783349744.114668:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.114672:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476177 expref: 17 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114681:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476177 expref: 17 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114692:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.114715:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3291:x1869977666740608:12345-0@lo:103: Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.114726:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349744.114739:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349744.114744:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3291:x1869977666740736:12345-0@lo:103: 00010000:00010000:1.0:1783349744.114750:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.114754:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847614d expref: 16 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114761:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a4847614d expref: 16 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.114770:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.114810:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3291:x1869977666740736:12345-0@lo:103: Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.114817:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349744.114829:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349744.114835:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:3293:x1869977666740864:12345-0@lo:103: 00010000:00010000:2.0:1783349744.114929:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d7534c00/0x68b4a22a4847617e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476177 expref: 15 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.114945:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739712:0@lo:104: 00010000:00010000:2.0:1783349744.114954:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9002a00/0x68b4a22a48476154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a4847614d expref: 14 pid: 5779 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.114962:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666740224:0@lo:104: 00000100:00100000:2.0:1783349744.114969:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666740352:0@lo:104: 00010000:00010000:1.0:1783349744.115173:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.115178:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476123 expref: 13 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.115186:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476123 expref: 13 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.115196:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030e00/0x68b4a22a4847612a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476123 expref: 13 pid: 5777 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.115204:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.115237:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:3293:x1869977666740864:12345-0@lo:103: Request processed in 403us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.115247:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349744.115292:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666740736:0@lo:103: 00000100:00100000:1.0:1783349744.115299:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666740608:0@lo:103: 00010000:00010000:1.0:1783349744.115311:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349744.115352:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666740864:0@lo:103: 00000100:00100000:2.0:1783349744.115833:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349744.115936:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185408 00000100:00100000:1.0:1783349744.115941:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185408 00010000:00010000:1.0:1783349744.115959:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 10 pid: 5777 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.115984:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:1.0:1783349744.115990:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2361:x1869977655185408:12345-192.168.204.36@tcp:103: 00010000:00010000:1.0:1783349744.115998:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.116002:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 10 pid: 5777 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.116012:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 10 pid: 5777 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.116022:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.116053:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2361:x1869977655185408:12345-192.168.204.36@tcp:103: Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.116059:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00010000:00010000:2.0:1783349744.116922:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102051c00/0x68b4a22a484761f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b86a expref: 9 pid: 5777 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349744.116935:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666738944:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349744.116943:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8290:1869977666739072:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349744.116978:0:8290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349744.117983:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349744.118083:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185536 00000100:00100000:1.0:1783349744.118090:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185536 00010000:00010000:1.0:1783349744.118117:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349744.118190:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:1.0:1783349744.118198:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:2362:x1869977655185536:12345-192.168.204.36@tcp:103: 00010000:00010000:1.0:1783349744.118211:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349744.118216:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118227:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118241:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d7534800/0x68b4a22a484761ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b863 expref: 9 pid: 5778 timeout: 231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118255:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118264:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118278:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118285:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118292:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118300:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118316:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051a00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349744.118320:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118328:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118350:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.118360:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349744.118432:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:2362:x1869977655185536:12345-192.168.204.36@tcp:103: Request processed in 234us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349744.118439:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00010000:00010000:3.0:1783349744.118477:0:8290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349744.118486:0:8290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349744.118493:0:8290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102051a00/0x68b4a22a4847622d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349744.297982:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349745.322013:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783349745.964389:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783349745.964398:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320c970f800 from 39 10000000:01000000:3.0:1783349745.964403:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783349745.964449:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.964461:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.964470:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349745.964494:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666740992:0@lo:101: 00000100:00100000:3.0:1783349745.964561:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349745.964629:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c5181000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349745.964761:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666740992 00000100:00100000:0.0:1783349745.964768:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666740992 00000100:00100000:0.0:1783349745.964853:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783349745.964863:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+12:5781:x1869977666740992:12345-0@lo:101: 00010000:00010000:0.0:1783349745.964877:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349745.964890:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175a400/0x68b4a22a4847623b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476234 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.964913:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175a400/0x68b4a22a4847623b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476234 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.964925:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175a400/0x68b4a22a4847623b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476234 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.964946:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175a400, rc 0) 00000100:00100000:0.0:1783349745.964996:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666740992:12345-0@lo:101: Request processed in 134us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349745.965003:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783349745.965089:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666740992:0@lo:101: 00010000:00010000:2.0:1783349745.965103:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.965112:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349745.965163:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741120:0@lo:501: 00000100:00100000:2.0:1783349745.965188:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.965225:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.965277:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741120 00000100:00100000:1.0:1783349745.965282:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741120 00000100:00100000:1.0:1783349745.965312:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783349745.965320:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666741120:12345-0@lo:501: 00000100:00100000:1.0:1783349745.965560:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666741120:12345-0@lo:501: Request processed in 240us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.965567:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783349745.965639:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741120:0@lo:501: 00000100:00100000:2.0:1783349745.965665:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741248:0@lo:503: 00000100:00100000:2.0:1783349745.965701:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.965721:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.965772:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741248 00000100:00100000:1.0:1783349745.965776:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741248 00000100:00100000:1.0:1783349745.965826:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783349745.965833:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666741248:12345-0@lo:503: 00000100:00100000:1.0:1783349745.965958:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666741248:12345-0@lo:503: Request processed in 126us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.965970:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783349745.966084:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741248:0@lo:503: 00000100:00100000:0.0:1783349745.966402:0:8306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8306:1869977666741376:0@lo:502: 00000100:00100000:0.0:1783349745.966440:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.966465:0:8306:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256180 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.966513:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741376 00000100:00100000:1.0:1783349745.966517:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741376 00000100:00100000:1.0:1783349745.966547:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783349745.966554:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:8306:x1869977666741376:12345-0@lo:502: 00000100:00100000:1.0:1783349745.966719:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:8306:x1869977666741376:12345-0@lo:502: Request processed in 165us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.966726:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783349745.966826:0:8306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8306:1869977666741376:0@lo:502: 00000100:00100000:2.0:1783349745.966863:0:8306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8306:1869977666741504:0@lo:502: 00000100:00100000:2.0:1783349745.966892:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.966919:0:8306:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349745.966967:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741504 00000100:00100000:0.0:1783349745.966971:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741504 00000100:00100000:0.0:1783349745.966990:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783349745.966996:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:8306:x1869977666741504:12345-0@lo:502: 00000100:00100000:0.0:1783349745.967128:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:8306:x1869977666741504:12345-0@lo:502: Request processed in 131us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349745.967135:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783349745.967212:0:8306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8306:1869977666741504:0@lo:502: 00000040:00080000:2.0:1783349745.967229:0:8306:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783349745.968079:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783349745.968098:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783349745.968107:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.968118:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349745.968128:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783349745.968130:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1783349745.968133:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783349745.968160:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.968179:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.968188:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349745.968203:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741632:0@lo:101: 00000100:00100000:0.0:1783349745.968240:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.968272:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256780 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.968325:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741632 00000100:00100000:1.0:1783349745.968331:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741632 00000100:00100000:1.0:1783349745.968369:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783349745.968377:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+13:5781:x1869977666741632:12345-0@lo:101: 00010000:00010000:1.0:1783349745.968386:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349745.968397:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb200/0x68b4a22a48476249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476242 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349745.968417:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb200/0x68b4a22a48476249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476242 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349745.968428:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb200/0x68b4a22a48476249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476242 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349745.968436:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb200, rc 0) 00000100:00100000:1.0:1783349745.968476:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666741632:12345-0@lo:101: Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.968482:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783349745.968553:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741632:0@lo:101: 00010000:00010000:2.0:1783349745.968565:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.968573:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349745.968615:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741760:0@lo:501: 00000100:00100000:2.0:1783349745.968639:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.968659:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349745.968775:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741760 00000100:00100000:0.0:1783349745.968780:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741760 00000100:00100000:0.0:1783349745.968835:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783349745.968842:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666741760:12345-0@lo:501: 00000100:00100000:0.0:1783349745.969053:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666741760:12345-0@lo:501: Request processed in 211us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349745.969059:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783349745.969138:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741760:0@lo:501: 00000100:00100000:2.0:1783349745.969162:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741888:0@lo:503: 00000100:00100000:2.0:1783349745.969203:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.969226:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.969270:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666741888 00000100:00100000:1.0:1783349745.969275:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666741888 00000100:00100000:1.0:1783349745.969298:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783349745.969303:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666741888:12345-0@lo:503: 00000100:00100000:1.0:1783349745.969438:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666741888:12345-0@lo:503: Request processed in 134us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.969444:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783349745.969909:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666741888:0@lo:503: 00000100:00100000:2.0:1783349745.971479:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8307:1869977666742016:0@lo:502: 00000100:00100000:2.0:1783349745.971547:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.971579:0:8307:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.971631:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742016 00000100:00100000:1.0:1783349745.971638:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742016 00000100:00100000:1.0:1783349745.971675:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783349745.971684:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:8307:x1869977666742016:12345-0@lo:502: 00000100:00100000:1.0:1783349745.971899:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:8307:x1869977666742016:12345-0@lo:502: Request processed in 216us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.971906:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783349745.972070:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8307:1869977666742016:0@lo:502: 00000020:01000000:2.0:1783349745.972094:0:8307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349745.972104:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349745.972106:0:8307:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783349745.972110:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783349745.972130:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8307:1869977666742144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349745.972163:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.972389:0:8307:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349745.972499:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742144 00000100:00100000:0.0:1783349745.972504:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742144 00000100:00100000:0.0:1783349745.972611:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783349745.972623:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:8307:x1869977666742144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349745.972756:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:8307:x1869977666742144:12345-0@lo:502:llog_process_th.0 Request processed in 135us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349745.972828:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8307:1869977666742144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349745.972847:0:8307:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349745.972851:0:8307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349745.972852:0:8307:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783349745.972856:0:8307:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1783349745.974870:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783349745.974894:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783349745.974905:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.974916:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349745.974942:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349745.974945:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320f70f3800 from 39 10000000:01000000:2.0:1783349745.974947:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349745.974976:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.974983:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.974991:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349745.975011:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349745.975061:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.975092:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.975120:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742272 00000100:00100000:3.0:1783349745.975127:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742272 00000100:00100000:0.0:1783349745.976167:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783349745.976353:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783349745.976364:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:5781:x1869977666742272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349745.976378:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349745.976397:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175a200/0x68b4a22a48476257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476250 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.976421:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175a200/0x68b4a22a48476257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476250 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.976431:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175a200/0x68b4a22a48476257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476250 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.976440:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175a200, rc 0) 00000100:00100000:0.0:1783349745.977894:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666742272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1527us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349745.977904:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783349745.978023:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349745.978040:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.978055:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349745.978117:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349745.978155:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.978188:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.978250:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742400 00000100:00100000:1.0:1783349745.978257:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742400 00000100:00100000:1.0:1783349745.978289:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783349745.978297:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666742400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349745.978524:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666742400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.978531:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783349745.978909:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.978941:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.979307:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.979329:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349745.984187:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742528 00000100:00100000:1.0:1783349745.984318:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742528 00000100:00100000:1.0:1783349745.984383:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783349745.984392:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666742528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349745.984984:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666742528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 591us (5675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349745.984993:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783349745.985137:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.986410:0:8308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8308:1869977666742656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349745.986484:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.986566:0:8308:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.986686:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742656 00000100:00100000:3.0:1783349745.986692:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742656 00000100:00100000:3.0:1783349745.986764:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783349745.986773:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:8308:x1869977666742656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349745.987024:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:8308:x1869977666742656:12345-0@lo:502:llog_process_th.0 Request processed in 252us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349745.987032:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783349745.987107:0:8308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8308:1869977666742656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349745.987153:0:8308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8308:1869977666742784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349745.987186:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.987538:0:8308:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349745.987628:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742784 00000100:00100000:2.0:1783349745.987633:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742784 00000100:00100000:2.0:1783349745.987664:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783349745.987671:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:8308:x1869977666742784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349745.989960:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:8308:x1869977666742784:12345-0@lo:502:llog_process_th.0 Request processed in 2281us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349745.989972:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783349745.990389:0:8308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8308:1869977666742784:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783349745.990424:0:8308:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783349745.993181:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1783349745.993212:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349745.993226:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.993237:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349745.993246:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783349745.993249:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783349745.993251:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783349745.993287:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.993297:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.993307:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349745.993330:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349745.993389:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.993476:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.993577:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666742912 00000100:00100000:3.0:1783349745.993585:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666742912 00000100:00100000:3.0:1783349745.993720:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783349745.993729:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:5781:x1869977666742912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349745.993742:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349745.993753:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9003000/0x68b4a22a48476265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847625e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.993774:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9003000/0x68b4a22a48476265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847625e expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.993784:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9003000/0x68b4a22a48476265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847625e expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.993822:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003000, rc 0) 00000100:00100000:3.0:1783349745.993912:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666742912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349745.993919:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783349745.994289:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666742912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349745.994555:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.994578:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349745.994694:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.994727:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.994847:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.994946:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743040 00000100:00100000:3.0:1783349745.994952:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743040 00000100:00100000:3.0:1783349745.994988:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783349745.994995:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666743040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349745.995273:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666743040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349745.995281:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783349745.995386:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.995420:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.995642:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.995672:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.995783:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743168 00000100:00100000:3.0:1783349745.995788:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743168 00000100:00100000:3.0:1783349745.995854:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783349745.995861:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666743168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349745.996138:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666743168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349745.996145:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783349745.996286:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349745.996742:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8309:1869977666743296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349745.996783:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349745.996841:0:8309:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349745.996893:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743296 00000100:00100000:2.0:1783349745.996903:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743296 00000100:00100000:2.0:1783349745.996937:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783349745.996944:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:8309:x1869977666743296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349745.997086:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:8309:x1869977666743296:12345-0@lo:502:llog_process_th.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349745.997092:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783349745.997184:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8309:1869977666743296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349745.997206:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349745.997215:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349745.997217:0:8309:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783349745.997222:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783349745.997243:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8309:1869977666743424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349745.997288:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.997305:0:8309:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349745.997355:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743424 00000100:00100000:2.0:1783349745.997359:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743424 00000100:00100000:2.0:1783349745.997375:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783349745.997380:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:8309:x1869977666743424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349745.997508:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:8309:x1869977666743424:12345-0@lo:502:llog_process_th.0 Request processed in 126us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349745.997515:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783349745.997670:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8309:1869977666743424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349745.997691:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349745.997695:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349745.997697:0:8309:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783349745.997700:0:8309:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1783349745.998192:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783349745.998213:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783349745.998222:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.998233:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349745.998242:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783349745.998245:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320c6fcb000 from 39 10000000:01000000:2.0:1783349745.998247:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349745.998270:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.998277:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349745.998294:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349745.998309:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349745.998342:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349745.998373:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.998568:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743552 00000100:00100000:3.0:1783349745.998573:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743552 00000100:00100000:3.0:1783349745.998608:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783349745.998614:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666743552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349745.998624:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349745.998635:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9003e00/0x68b4a22a48476273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847626c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.998656:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9003e00/0x68b4a22a48476273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847626c expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.998667:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9003e00/0x68b4a22a48476273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847626c expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349745.998686:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003e00, rc 0) 00000100:00100000:3.0:1783349745.998728:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666743552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349745.998735:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783349745.998834:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349745.998846:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349745.998855:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349745.998894:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.998917:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.998930:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349745.998984:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743680 00000100:00100000:3.0:1783349745.998988:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743680 00000100:00100000:3.0:1783349745.999005:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783349745.999011:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666743680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349745.999229:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666743680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349745.999237:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783349745.999300:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.999330:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349745.999366:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349745.999387:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349745.999498:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743808 00000100:00100000:2.0:1783349745.999504:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743808 00000100:00100000:2.0:1783349745.999524:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783349745.999530:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666743808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349745.999670:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666743808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349745.999677:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783349745.999741:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666743808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349746.000203:0:8310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8310:1869977666743936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349746.000238:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349746.000300:0:8310:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349746.000329:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666743936 00000100:00100000:2.0:1783349746.000333:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666743936 00000100:00100000:2.0:1783349746.000387:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783349746.000394:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8310:x1869977666743936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349746.000652:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8310:x1869977666743936:12345-0@lo:502:llog_process_th.0 Request processed in 257us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.000659:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783349746.000736:0:8310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8310:1869977666743936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349746.000775:0:8310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8310:1869977666744064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349746.000882:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349746.000959:0:8310:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256240 going to sleep for 10 seconds 00000100:00100000:2.0:1783349746.001199:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744064 00000100:00100000:2.0:1783349746.001204:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744064 00000100:00100000:2.0:1783349746.001302:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783349746.001309:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8310:x1869977666744064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349746.001461:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8310:x1869977666744064:12345-0@lo:502:llog_process_th.0 Request processed in 151us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.001474:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783349746.001528:0:8310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8310:1869977666744064:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783349746.001549:0:8310:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783349746.001765:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1783349746.001784:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783349746.001865:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349746.001876:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349746.001885:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783349746.001887:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1783349746.001890:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783349746.001913:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349746.001921:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349746.001940:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349746.001955:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349746.001983:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349746.002002:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349746.002093:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744192 00000100:00100000:0.0:1783349746.002098:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744192 00000100:00100000:0.0:1783349746.002117:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783349746.002124:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666744192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349746.002132:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349746.002143:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175a800/0x68b4a22a48476281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847627a expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349746.002160:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175a800/0x68b4a22a48476281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847627a expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349746.002171:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175a800/0x68b4a22a48476281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847627a expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349746.002179:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175a800, rc 0) 00000100:00100000:0.0:1783349746.002208:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666744192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349746.002214:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783349746.002478:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349746.002491:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349746.002499:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349746.002538:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349746.002563:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349746.003695:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349746.003737:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744320 00000100:00100000:0.0:1783349746.003744:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744320 00000100:00100000:0.0:1783349746.003888:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783349746.003898:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666744320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349746.004188:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666744320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349746.004196:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783349746.004297:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349746.004331:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349746.004370:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349746.004396:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da300 going to sleep for 11 seconds 00000100:00100000:1.0:1783349746.004441:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744448 00000100:00100000:1.0:1783349746.004455:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744448 00000100:00100000:1.0:1783349746.004487:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783349746.004494:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666744448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349746.004637:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666744448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349746.004644:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783349746.004832:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349746.005170:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8311:1869977666744576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349746.005206:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349746.005234:0:8311:0:(client.c:2701:ptlrpc_set_wait()) set ffff9321005da300 going to sleep for 11 seconds 00000100:00100000:1.0:1783349746.005286:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744576 00000100:00100000:1.0:1783349746.005290:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744576 00000100:00100000:1.0:1783349746.005319:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783349746.005327:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8311:x1869977666744576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349746.005492:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8311:x1869977666744576:12345-0@lo:502:llog_process_th.0 Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349746.005499:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783349746.005572:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8311:1869977666744576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349746.005595:0:8311:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349746.005604:0:8311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349746.005607:0:8311:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783349746.005612:0:8311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783349746.005631:0:8311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8311:1869977666744704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349746.005663:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349746.005684:0:8311:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0a380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349746.005984:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744704 00000100:00100000:1.0:1783349746.005989:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744704 00000100:00100000:1.0:1783349746.006009:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783349746.006015:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8311:x1869977666744704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349746.006153:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8311:x1869977666744704:12345-0@lo:502:llog_process_th.0 Request processed in 136us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349746.006160:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783349746.006234:0:8311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8311:1869977666744704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349746.006253:0:8311:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349746.006258:0:8311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349746.006260:0:8311:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783349746.006263:0:8311:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783349746.006441:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1783349746.006456:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783349746.006465:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349746.006475:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349746.006536:0:5781:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783349746.006539:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9320c75e8000 from 1 10000000:01000000:1.0:1783349746.006541:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783349746.006563:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349746.006572:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349746.006580:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349746.006594:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783349746.006621:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349746.006650:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc4648840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349746.006695:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744832 00000100:00100000:2.0:1783349746.006699:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744832 00000100:00100000:2.0:1783349746.006731:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783349746.006738:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666744832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349746.006747:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349746.006757:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102050c00/0x68b4a22a4847628f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476288 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.006777:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102050c00/0x68b4a22a4847628f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476288 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.006786:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102050c00/0x68b4a22a4847628f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476288 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.006833:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050c00, rc 0) 00000100:00100000:2.0:1783349746.006864:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666744832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.006870:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783349746.006976:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349746.006988:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349746.006996:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349746.007036:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349746.007060:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349746.007084:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc4648840 going to sleep for 11 seconds 00000100:00100000:2.0:1783349746.007127:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666744960 00000100:00100000:2.0:1783349746.007132:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666744960 00000100:00100000:2.0:1783349746.007161:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783349746.007168:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666744960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349746.007398:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666744960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (336us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349746.007405:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783349746.009038:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666744960:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783349746.009152:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783349746.009163:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349746.009419:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349746.345984:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349746.460110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349746.460173:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185664 00000100:00100000:2.0:1783349746.460194:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185664 00000100:00100000:2.0:1783349746.460289:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:2.0:1783349746.460300:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:5568:x1869977655185664:12345-192.168.204.36@tcp:101: 00010000:00010000:2.0:1783349746.460317:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349746.460334:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102050000/0x68b4a22a48476296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b8cc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.460361:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102050000/0x68b4a22a48476296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8cc expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.460372:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102050000/0x68b4a22a48476296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8cc expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.460383:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050000, rc 0) 00000100:00100000:2.0:1783349746.460442:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655185664:12345-192.168.204.36@tcp:101: Request processed in 145us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.460450:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:0.0:1783349746.467541:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349746.467642:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185792 00000100:00100000:3.0:1783349746.467652:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185792 00000100:00100000:3.0:1783349746.467723:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:3.0:1783349746.467733:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655185792:12345-192.168.204.36@tcp:501: 00000100:00100000:3.0:1783349746.468070:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655185792:12345-192.168.204.36@tcp:501: Request processed in 338us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349746.468079:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:0.0:1783349746.477902:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349746.477982:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655185920 00000100:00100000:2.0:1783349746.477992:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655185920 00000100:00100000:2.0:1783349746.478043:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:2.0:1783349746.478052:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655185920:12345-192.168.204.36@tcp:503: 00000100:00100000:2.0:1783349746.478249:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655185920:12345-192.168.204.36@tcp:503: Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.478256:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:1.0:1783349746.483390:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349746.483555:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186048 00000100:00100000:2.0:1783349746.483565:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186048 00000100:00100000:2.0:1783349746.483631:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:2.0:1783349746.483641:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:6047:x1869977655186048:12345-192.168.204.36@tcp:502: 00000100:00100000:2.0:1783349746.484053:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:6047:x1869977655186048:12345-192.168.204.36@tcp:502: Request processed in 412us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.484062:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:0.0:1783349746.486632:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349746.486709:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186176 00000100:00100000:3.0:1783349746.486718:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186176 00000100:00100000:3.0:1783349746.486779:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:3.0:1783349746.486787:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:6047:x1869977655186176:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783349746.487067:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:6047:x1869977655186176:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 281us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349746.487072:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:0.0:1783349746.489431:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349746.489922:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186304 00000100:00100000:2.0:1783349746.489930:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186304 00000100:00100000:2.0:1783349746.490008:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:2.0:1783349746.490016:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655186304:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349746.490030:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349746.490045:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff932102051800/0x68b4a22a4847629d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b8d3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.490070:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff932102051800/0x68b4a22a4847629d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8d3 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.490080:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff932102051800/0x68b4a22a4847629d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8d3 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349746.490089:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102051800, rc 0) 00000100:00100000:2.0:1783349746.490140:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186304:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 125us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349746.490147:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:0.0:1783349746.492246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349746.492305:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186432 00000100:00100000:1.0:1783349746.492312:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186432 00000100:00100000:1.0:1783349746.492348:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:1.0:1783349746.492357:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186432:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349746.492621:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186432:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 265us (379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783349746.492628:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:3.0:1783349747.050282:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349747.050306:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666745088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349747.050369:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349747.050416:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745088 00000100:00100000:2.0:1783349747.050425:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745088 00000100:00100000:2.0:1783349747.050482:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783349747.050487:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1783349747.050495:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666745088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349747.050500:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:0.0:1783349747.050525:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783349747.050534:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349747.050593:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666745088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349747.050615:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783349747.050659:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320ec480700 x1869977666745088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349747.050679:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666745088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783349747.370013:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783349747.848334:0:8350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc04c78460 20000000:00000080:1.0:1783349747.848351:0:8350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931fc6dee000 uarg=0000000000000000 20000000:01000000:1.0:1783349747.848384:0:8350:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783349747.848390:0:8350:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783349747.848395:0:8350:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783349747.849140:0:8351:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1783349747.849287:0:8350:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1783349747.853690:0:8350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1783349747.853748:0:8350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1783349747.854325:0:8350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1783349747.854346:0:8350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783349747.854364:0:8350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854393:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476012 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854402:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476074 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854421:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847613f expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854431:0:8350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854439:0:8350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854478:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854493:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 9 pid: 5778 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.854508:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745216:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349747.854644:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a4847613f expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854653:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a4847613f expref: 18 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.854662:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745344:0@lo:104: 00000100:00100000:1.0:1783349747.854701:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349747.854742:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476074 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854750:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476074 expref: 18 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.854783:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745472:0@lo:104: 00000100:00100000:1.0:1783349747.854829:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349747.854850:0:8350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476012 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.854858:0:8350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476012 expref: 18 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.854867:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745600:0@lo:104: 00000100:00100000:1.0:1783349747.854887:0:8350:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349747.854958:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783349747.854977:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349747.854988:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745344 00000100:00100000:3.0:1783349747.854995:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745344 00000100:00100000:3.0:1783349747.855029:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745472 00000100:00100000:3.0:1783349747.855032:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745472 00000100:00100000:3.0:1783349747.855040:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745600 00000100:00100000:3.0:1783349747.855042:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745600 00000100:00100000:3.0:1783349747.855054:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349747.855061:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:8350:x1869977666745344:12345-0@lo:104: 00010000:00010000:3.0:1783349747.855072:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855127:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349747.855171:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:8350:x1869977666745344:12345-0@lo:104: Request processed in 73us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.855180:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783349747.855197:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349747.855204:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e4067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:8350:x1869977666745472:12345-0@lo:104: 00010000:00010000:3.0:1783349747.855215:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855252:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783349747.855258:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e4067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:8350:x1869977666745472:12345-0@lo:104: Request processed in 55us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.855264:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783349747.855315:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349747.855322:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:8350:x1869977666745600:12345-0@lo:104: 00010000:00010000:3.0:1783349747.855330:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855364:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783349747.855369:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:8350:x1869977666745600:12345-0@lo:104: Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.855374:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1783349747.855395:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783349747.855400:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855407:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349747.855411:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855419:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349747.855427:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349747.855433:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783349747.855461:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855468:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349747.855487:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855505:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9002c00/0x68b4a22a4847613f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476146 expref: -99 pid: 7475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855518:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349747.855521:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855527:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d7535600 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349747.855530:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855537:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349747.855543:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349747.855548:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783349747.855561:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855567:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349747.855574:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855580:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d7535600/0x68b4a22a48476074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847607b expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855590:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349747.855598:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855605:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0031c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349747.855608:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855615:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349747.855621:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349747.855626:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783349747.855639:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855646:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349747.855662:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855668:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48476012 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476019 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.855682:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349747.855684:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349747.855686:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349747.855692:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349747.855697:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349747.855709:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666745728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349747.855736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349747.855786:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349747.855814:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666745856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349747.855836:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349747.855863:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666745984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349747.855883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349747.855912:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745728 00000100:00100000:3.0:1783349747.855917:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745728 00010000:00010000:3.0:1783349747.855934:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847613f expref: 19 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349747.855949:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745856 00000100:00100000:3.0:1783349747.855951:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745856 00010000:00010000:3.0:1783349747.855961:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476074 expref: 20 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349747.855971:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666745984 00000100:00100000:3.0:1783349747.855974:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666745984 00010000:00010000:3.0:1783349747.855983:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476012 expref: 21 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349747.855997:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349747.856004:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+21:3291:x1869977666745728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349747.856014:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349747.856020:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847613f expref: 21 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.856029:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a4847613f expref: 21 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.856044:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349747.856083:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+21:3291:x1869977666745728:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.856090:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349747.856103:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783349747.856109:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:3291:x1869977666745856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349747.856117:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349747.856122:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476074 expref: 20 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.856130:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476074 expref: 20 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.856139:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349747.856159:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:3291:x1869977666745856:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.856165:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783349747.856176:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783349747.856183:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666745984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349747.856192:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349747.856196:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476012 expref: 19 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.856205:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476012 expref: 19 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.856213:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349747.856242:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666745984:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349747.856247:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666745856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349747.856254:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783349747.856262:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666745728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349747.856297:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666745984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783349747.856489:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0031800/0x68b4a22a48476146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a4847613f expref: 18 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.856501:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745344:0@lo:104: 00010000:00010000:1.0:1783349747.856511:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673dc00/0x68b4a22a4847607b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476074 expref: 17 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.856521:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745472:0@lo:104: 00010000:00010000:1.0:1783349747.856530:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050400/0x68b4a22a48476019 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476012 expref: 16 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349747.856538:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745600:0@lo:104: 00000100:00100000:1.0:1783349747.860311:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8350:1869977666745216:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349747.860355:0:8350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349747.865368:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349747.865641:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186560 00000100:00100000:3.0:1783349747.865651:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186560 00010000:00010000:3.0:1783349747.865688:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 10 pid: 5778 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349747.865832:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:3.0:1783349747.865843:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2361:x1869977655186560:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349747.865859:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349747.865865:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 10 pid: 5778 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865877:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 10 pid: 5778 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865894:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050600/0x68b4a22a48476203 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b89b expref: 10 pid: 5778 timeout: 234 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865910:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865917:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865932:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865938:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865964:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865970:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865975:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349747.865978:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.865986:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.866007:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.866017:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349747.866066:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:2361:x1869977655186560:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 225us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.866073:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00010000:00010000:1.0:1783349747.866127:0:8350:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.866145:0:8350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349747.866152:0:8350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faaca600/0x68b4a22a484762a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349747.985862:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349747.985879:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c970f800 from 4 10000000:01000000:0.0:1783349747.985884:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349747.985929:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349747.985941:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349747.985952:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349747.985994:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349747.986061:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349747.986129:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746112 00000100:00100000:0.0:1783349747.986130:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb2560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349747.986138:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746112 00000100:00100000:2.0:1783349747.986186:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783349747.986195:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666746112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349747.986209:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349747.986221:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484762ab expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349747.986245:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484762ab expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349747.986256:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484762ab expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349747.986265:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96000, rc 0) 00000100:00100000:2.0:1783349747.986323:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666746112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349747.986330:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783349747.988464:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349747.988490:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349747.988502:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349747.988578:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349747.988879:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349747.988919:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb2560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349747.989023:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746240 00000100:00100000:3.0:1783349747.989030:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746240 00000100:00100000:3.0:1783349747.989091:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783349747.989099:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666746240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349747.989363:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666746240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.989576:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783349747.989673:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349747.989709:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349747.989750:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349747.989783:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb2560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349747.989873:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746368 00000100:00100000:1.0:1783349747.989878:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746368 00000100:00100000:1.0:1783349747.989914:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783349747.989922:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666746368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349747.990197:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666746368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349747.990204:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783349747.990277:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349747.990870:0:8363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8363:1869977666746496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349747.990912:0:8363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349747.991013:0:8363:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256600 going to sleep for 11 seconds 00000100:00100000:3.0:1783349747.991180:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746496 00000100:00100000:3.0:1783349747.991192:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746496 00000100:00100000:3.0:1783349747.991227:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783349747.991236:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8363:x1869977666746496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349747.991881:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8363:x1869977666746496:12345-0@lo:502:llog_process_th.0 Request processed in 644us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349747.991888:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783349747.992167:0:8363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8363:1869977666746496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349747.992195:0:8363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349747.992210:0:8363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349747.992212:0:8363:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783349747.992221:0:8363:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320c970f800 00000020:00000080:0.0:1783349747.992223:0:8363:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349747.992344:0:8363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8363:1869977666746624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349747.992396:0:8363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349747.992426:0:8363:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349747.994013:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746624 00000100:00100000:2.0:1783349747.994025:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746624 00000100:00100000:2.0:1783349747.994082:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783349747.994092:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8363:x1869977666746624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349747.994307:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:8363:x1869977666746624:12345-0@lo:502:llog_process_th.0 Request processed in 216us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349747.994315:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783349747.994577:0:8363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8363:1869977666746624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349747.994609:0:8363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349747.994616:0:8363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349747.994618:0:8363:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783349747.994623:0:8363:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783349747.996816:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783349747.996847:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349747.996859:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349747.996871:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349747.996882:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783349747.996884:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f70f3800 from 4 10000000:01000000:2.0:1783349747.996887:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349747.996930:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349747.996939:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349747.996948:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349747.996971:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349747.997027:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349747.997065:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349747.999854:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746752 00000100:00100000:3.0:1783349747.999867:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746752 00000100:00100000:3.0:1783349747.999913:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783349747.999922:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666746752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349747.999942:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349747.999961:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484762b9 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349747.999995:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349748.000009:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349748.000020:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002c00, rc 0) 00000100:00100000:3.0:1783349748.000095:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666746752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (3066us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349748.000102:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783349748.000312:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349748.000334:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349748.000345:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349748.000428:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.000460:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.000499:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349748.000612:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666746880 00000100:00100000:3.0:1783349748.000617:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666746880 00000100:00100000:3.0:1783349748.000645:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783349748.000654:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666746880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349748.000956:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666746880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349748.000963:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783349748.001142:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666746880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.001171:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.001203:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.001227:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349748.001919:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747008 00000100:00100000:3.0:1783349748.001925:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747008 00000100:00100000:3.0:1783349748.001958:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783349748.001965:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666747008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349748.002124:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666747008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349748.002130:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783349748.002214:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.002535:0:8366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8366:1869977666747136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349748.002570:0:8366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.002599:0:8366:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349748.002649:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747136 00000100:00100000:3.0:1783349748.002654:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747136 00000100:00100000:3.0:1783349748.002682:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783349748.002689:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8366:x1869977666747136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349748.002843:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8366:x1869977666747136:12345-0@lo:502:llog_process_th.0 Request processed in 154us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349748.002850:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783349748.002935:0:8366:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8366:1869977666747136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349748.002956:0:8366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349748.002965:0:8366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349748.002967:0:8366:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783349748.002973:0:8366:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320f70f3800 00000020:00000080:2.0:1783349748.002976:0:8366:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783349748.003049:0:8366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8366:1869977666747264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349748.003082:0:8366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.003099:0:8366:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a180 going to sleep for 11 seconds 00000100:00100000:3.0:1783349748.003146:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747264 00000100:00100000:3.0:1783349748.003151:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747264 00000100:00100000:3.0:1783349748.003181:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783349748.003188:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8366:x1869977666747264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349748.003295:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:8366:x1869977666747264:12345-0@lo:502:llog_process_th.0 Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349748.003303:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783349748.003719:0:8366:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8366:1869977666747264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349748.003739:0:8366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349748.003744:0:8366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349748.003750:0:8366:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783349748.003754:0:8366:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783349748.004081:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783349748.004098:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349748.004114:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349748.004126:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349748.004135:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349748.004137:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c6fcb000 from 4 10000000:01000000:3.0:1783349748.004140:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349748.004162:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349748.004169:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349748.004178:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349748.004192:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349748.004225:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349748.008677:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c75480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349748.009932:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747392 00000100:00100000:2.0:1783349748.009944:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747392 00000100:00100000:2.0:1783349748.010001:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783349748.010070:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666747392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349748.010087:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349748.010105:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484762c7 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349748.010132:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349748.010144:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349748.010154:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96e00, rc 0) 00000100:00100000:2.0:1783349748.010220:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666747392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (5994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.010227:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783349748.010278:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349748.010293:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349748.010303:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349748.010369:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.010401:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.010436:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349748.010450:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747520 00000100:00100000:2.0:1783349748.010454:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747520 00000100:00100000:2.0:1783349748.010477:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783349748.010484:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666747520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.010734:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666747520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.010742:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783349748.010785:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.010831:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.010869:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.010883:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349748.010894:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747648 00000100:00100000:2.0:1783349748.010897:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747648 00000100:00100000:2.0:1783349748.010917:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783349748.013175:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666747648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.013370:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666747648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.017427:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783349748.017508:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666747648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349748.017887:0:8368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8368:1869977666747776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349748.017952:0:8368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349748.018001:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747776 00000100:00100000:1.0:1783349748.018009:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747776 00000100:00100000:2.0:1783349748.018010:0:8368:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349748.018061:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783349748.018070:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:8368:x1869977666747776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349748.018656:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:8368:x1869977666747776:12345-0@lo:502:llog_process_th.0 Request processed in 584us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349748.018666:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783349748.019945:0:8368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8368:1869977666747776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349748.019978:0:8368:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349748.019994:0:8368:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349748.019997:0:8368:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783349748.020015:0:8368:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320c6fcb000 00000020:00000080:2.0:1783349748.020018:0:8368:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783349748.020106:0:8368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8368:1869977666747904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349748.020156:0:8368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349748.020194:0:8368:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681840 going to sleep for 11 seconds 00000100:00100000:1.0:1783349748.020927:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666747904 00000100:00100000:1.0:1783349748.020936:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666747904 00000100:00100000:1.0:1783349748.020990:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783349748.020999:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:8368:x1869977666747904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349748.021212:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:8368:x1869977666747904:12345-0@lo:502:llog_process_th.0 Request processed in 214us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349748.021228:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783349748.021900:0:8368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:8368:1869977666747904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349748.021928:0:8368:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349748.021934:0:8368:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349748.021936:0:8368:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783349748.021940:0:8368:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783349748.022082:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783349748.022099:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349748.022109:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349748.022120:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349748.105289:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349748.107193:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186688 00000100:00100000:1.0:1783349748.107205:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186688 00000100:00100000:1.0:1783349748.107269:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:1.0:1783349748.107279:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:5568:x1869977655186688:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349748.107298:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349748.107315:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b8da expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349748.107543:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349748.107558:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349748.107567:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca600, rc 0) 00000100:00100000:1.0:1783349748.107630:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186688:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 353us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349748.107637:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:0.0:1783349748.110742:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349748.110863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186816 00000100:00100000:1.0:1783349748.110874:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186816 00000100:00100000:1.0:1783349748.110927:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:1.0:1783349748.110937:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186816:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349748.111215:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186816:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 279us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349748.111224:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:0.0:1783349748.113428:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349748.113520:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655186944 00000100:00100000:1.0:1783349748.113528:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655186944 00000100:00100000:1.0:1783349748.113577:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:1.0:1783349748.113586:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186944:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349748.113778:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:5568:x1869977655186944:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 192us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349748.113786:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:0.0:1783349748.116871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349748.116948:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187072 00000100:00100000:1.0:1783349748.116956:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187072 00000100:00100000:1.0:1783349748.117052:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 183 00000100:00100000:1.0:1783349748.117062:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:6097:x1869977655187072:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349748.117279:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:6097:x1869977655187072:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 217us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349748.117287:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 183 00000100:00100000:0.0:1783349748.119443:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349748.123862:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187200 00000100:00100000:2.0:1783349748.123875:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187200 00000100:00100000:2.0:1783349748.123930:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:2.0:1783349748.123940:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:6097:x1869977655187200:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783349748.124211:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:6097:x1869977655187200:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 271us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.124266:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 184 00010000:00010000:3.0:1783349748.394915:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349748.588617:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666748032:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.588679:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349748.588718:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666748544:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.588762:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349748.588809:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349748.588815:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666748416:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.588840:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349748.588866:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666748160:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.588887:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349748.588902:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349748.588913:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666748288:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.588934:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349748.588962:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748544 00000100:00100000:0.0:1783349748.588968:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748544 00000100:00100000:0.0:1783349748.589008:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748288 00000100:00100000:0.0:1783349748.589011:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748288 00000100:00100000:0.0:1783349748.589037:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349748.589045:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666748544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.589104:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666748544:12345-0@lo:400:kworker.0 Request processed in 60us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349748.589111:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349748.589129:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783349748.589136:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666748288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.589167:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666748288:12345-0@lo:400:kworker.0 Request processed in 32us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349748.589173:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783349748.589191:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748032 00000100:00100000:0.0:1783349748.589194:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748032 00000100:00100000:0.0:1783349748.589214:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748416 00000100:00100000:0.0:1783349748.589217:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748416 00010000:00080000:3.0:1783349748.589223:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7182d80 x1869977666748544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349748.589227:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748160 00000100:00100000:0.0:1783349748.589229:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748160 00000100:00100000:0.0:1783349748.589239:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783349748.589242:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666748544:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.589244:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666748032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349748.589292:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666748032:0@lo:400:kworker.0 00000100:00100000:2.0:1783349748.589365:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349748.589374:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666748416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349748.589450:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666748416:12345-0@lo:400:kworker.0 Request processed in 78us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.589457:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349748.589472:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783349748.589478:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666748160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349748.589502:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666748160:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.589514:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1783349748.589563:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783349748.589568:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783349748.589655:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7181500 x1869977666748288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349748.589665:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666748288:0@lo:400:kworker.0 00000100:00100000:2.0:1783349748.589674:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666748160:0@lo:400:kworker.0 00000100:00100000:0.0:1783349748.589935:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666748032:12345-0@lo:400:kworker.0 Request processed in 32us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349748.589942:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783349748.590068:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666748416:0@lo:400:kworker.0 00000100:00100000:2.0:1783349748.829564:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349748.829596:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349748.829625:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187456 00000100:00100000:2.0:1783349748.829634:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187456 00000100:00100000:2.0:1783349748.829694:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:2.0:1783349748.829709:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655187456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349748.829782:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655187456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349748.829816:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00080000:2.0:1783349748.829836:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349748.830702:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187328 00000100:00100000:3.0:1783349748.830709:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187328 00000100:00100000:3.0:1783349748.830760:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:3.0:1783349748.830768:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2359:x1869977655187328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349748.830828:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2359:x1869977655187328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 60us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349748.830835:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:2.0:1783349748.833447:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349748.833485:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349748.833563:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187712 00000100:00100000:0.0:1783349748.833577:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187712 00000100:00100000:0.0:1783349748.833632:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187584 00000100:00100000:0.0:1783349748.833635:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187584 00000100:00100000:0.0:1783349748.833652:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:0.0:1783349748.833661:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655187712:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349748.833719:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655187712:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349748.833727:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:0.0:1783349748.833741:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349748.833757:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655187584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349748.833782:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655187584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349748.833809:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00080000:2.0:1783349748.833873:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349748.833877:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349749.097974:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666748672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349749.098054:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349749.098150:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748672 00000100:00100000:3.0:1783349749.098158:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748672 00000100:00100000:3.0:1783349749.098220:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349749.098232:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666748672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349749.098267:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349749.098384:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666748672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349749.098391:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783349749.098817:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba3b80 x1869977666748672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349749.098847:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666748672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349749.417997:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349750.444069:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349751.470688:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349751.525319:0:8648:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1783349752.171135:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666748800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349752.171221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349752.171328:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748800 00000100:00100000:1.0:1783349752.171336:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748800 00000100:00100000:1.0:1783349752.171409:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783349752.171419:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666748800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349752.171451:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349752.171491:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666748800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349752.171498:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783349752.171621:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349752.171649:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a10700 x1869977666748800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349752.171672:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666748800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783349752.490039:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349753.515042:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349753.706327:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666748928:0@lo:400:kworker.0 00000100:00100000:0.0:1783349753.706398:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349753.706512:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666748928 00000100:00100000:2.0:1783349753.706520:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666748928 00000100:00100000:2.0:1783349753.706561:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783349753.706570:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666748928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349753.706826:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666749056:0@lo:400:kworker.0 00000100:00100000:1.0:1783349753.706843:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666749312:0@lo:400:kworker.0 00000100:00100000:3.0:1783349753.706877:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349753.706885:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349753.706908:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349753.706914:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666749184:0@lo:400:kworker.0 00000100:00100000:0.0:1783349753.707023:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666748928:0@lo:400:kworker.0 00000100:00100000:0.0:1783349753.707040:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666749440:0@lo:400:kworker.0 00000100:00100000:1.0:1783349753.707075:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349753.707085:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666749568:0@lo:400:kworker.0 00000100:00100000:1.0:1783349753.707109:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749312 00000100:00100000:1.0:1783349753.707113:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749312 00000100:00100000:3.0:1783349753.707118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349753.707148:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749568 00000100:00100000:1.0:1783349753.707152:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749568 00000100:00100000:3.0:1783349753.707170:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749056 00000100:00100000:1.0:1783349753.707183:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349753.707189:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666749312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349753.707226:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666749312:12345-0@lo:400:kworker.0 Request processed in 37us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.707233:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349753.707249:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349753.707255:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666749568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349753.707283:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666749568:12345-0@lo:400:kworker.0 Request processed in 29us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.707289:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349753.707303:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749184 00000100:00100000:1.0:1783349753.707306:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749184 00000100:00100000:1.0:1783349753.707328:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783349753.707333:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666749184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349753.707351:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749056 00000100:00100000:1.0:1783349753.707361:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666749184:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.707369:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783349753.707385:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783349753.707393:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666749056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349753.707412:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666748928:12345-0@lo:400:kworker.0 Request processed in 842us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349753.707421:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783349753.707433:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666749056:12345-0@lo:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349753.709917:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349753.712018:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749440 00000100:00100000:2.0:1783349753.712031:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749440 00000100:00080000:1.0:1783349753.713751:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349753.713758:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349753.713819:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666749056:0@lo:400:kworker.0 00010000:00080000:1.0:1783349753.713839:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a11180 x1869977666749568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349753.713864:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666749568:0@lo:400:kworker.0 00000100:00100000:1.0:1783349753.713908:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666749184:0@lo:400:kworker.0 00010000:00080000:1.0:1783349753.713921:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a12d80 x1869977666749312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349753.713930:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666749312:0@lo:400:kworker.0 00000100:00100000:3.0:1783349753.715378:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349753.715512:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349753.715527:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666749440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349753.715626:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666749440:12345-0@lo:400:kworker.0 Request processed in 104us (5714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349753.715633:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349753.715680:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666749440:0@lo:400:kworker.0 00000100:00100000:2.0:1783349753.952972:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349753.953073:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187968 00000100:00100000:1.0:1783349753.953083:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187968 00000100:00100000:1.0:1783349753.953189:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349753.953199:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655187968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349753.953268:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655187968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349753.953276:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00080000:2.0:1783349753.953412:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349753.958132:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349753.958184:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349753.958213:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349753.958246:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655187840 00000100:00100000:2.0:1783349753.958256:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655187840 00000100:00100000:2.0:1783349753.958301:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:2.0:1783349753.958311:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655187840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349753.958388:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655187840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349753.958396:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:2.0:1783349753.958432:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188224 00000100:00100000:2.0:1783349753.958436:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188224 00000100:00100000:2.0:1783349753.958473:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188096 00000100:00100000:2.0:1783349753.958476:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188096 00000100:00100000:2.0:1783349753.958497:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:2.0:1783349753.958503:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655188224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349753.958533:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655188224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349753.958538:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:2.0:1783349753.958549:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:2.0:1783349753.958554:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655188096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349753.958577:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655188096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349753.958582:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00080000:2.0:1783349753.958859:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349753.958864:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349754.218182:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666749696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349754.218253:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349754.218356:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749696 00000100:00100000:2.0:1783349754.218364:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749696 00000100:00100000:2.0:1783349754.218427:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349754.218438:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666749696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349754.218507:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349754.218561:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666749696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349754.219269:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783349754.219334:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320ec483b80 x1869977666749696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349754.219364:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666749696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349754.538779:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349754.784950:0:8893:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing yml_node 00010000:00010000:0.0:1783349755.561951:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349756.586124:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349757.290826:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666749824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349757.290903:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349757.293398:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749824 00000100:00100000:1.0:1783349757.293413:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749824 00000100:00100000:1.0:1783349757.293571:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349757.293584:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666749824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349757.293639:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349757.293738:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666749824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349757.293746:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783349757.294306:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a12d80 x1869977666749824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349757.294327:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666749824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783349757.294450:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783349757.611119:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349758.115924:0:9086:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.84 00010000:00010000:3.0:1783349758.635155:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349758.826942:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666749952:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.827020:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.827064:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666750464:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.827092:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.827116:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783349758.827122:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666750080:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.827142:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.827163:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666750592:0@lo:400:kworker.0 00000100:00100000:0.0:1783349758.827185:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666750336:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.827192:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.827227:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666749952 00000100:00100000:0.0:1783349758.827229:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349758.827235:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666749952 00000100:00100000:0.0:1783349758.827258:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349758.827267:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666750208:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.827282:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783349758.827293:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666749952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349758.827297:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349758.827336:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750592 00000100:00100000:0.0:1783349758.827341:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750592 00000100:00100000:1.0:1783349758.827350:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666749952:12345-0@lo:400:kworker.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.827358:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783349758.827387:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750336 00000100:00100000:0.0:1783349758.827392:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750336 00000100:00100000:1.0:1783349758.827399:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750464 00000100:00100000:1.0:1783349758.827404:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750464 00000100:00100000:0.0:1783349758.827423:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783349758.827432:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666750592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.827436:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750080 00000100:00100000:1.0:1783349758.827440:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750080 00000100:00100000:1.0:1783349758.827456:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750208 00000100:00100000:1.0:1783349758.827458:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750208 00000100:00100000:0.0:1783349758.827473:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666750592:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.827478:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783349758.827485:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349758.827489:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666750464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349758.827503:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783349758.827511:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666750336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349758.827538:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666750336:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349758.827544:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1783349758.827557:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349758.827972:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666750464:12345-0@lo:400:kworker.0 Request processed in 485us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.827980:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783349758.827993:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783349758.828004:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666750080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.828032:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666750080:12345-0@lo:400:kworker.0 Request processed in 29us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.828038:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783349758.828050:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783349758.828055:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666750208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.828080:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666750208:12345-0@lo:400:kworker.0 Request processed in 25us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349758.828086:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783349758.828132:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666750080:0@lo:400:kworker.0 00010000:00080000:1.0:1783349758.828145:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a13480 x1869977666750592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349758.828155:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666750592:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.828164:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666749952:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.828172:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666750464:0@lo:400:kworker.0 00000100:00100000:1.0:1783349758.828227:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666750208:0@lo:400:kworker.0 00010000:00080000:1.0:1783349758.828237:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a12d80 x1869977666750336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349758.828246:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666750336:0@lo:400:kworker.0 00000100:00080000:0.0:1783349758.829686:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349759.070703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349759.070758:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349759.070867:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188608 00000100:00100000:3.0:1783349759.070879:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188608 00000100:00100000:0.0:1783349759.070941:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188352 00000100:00100000:0.0:1783349759.070946:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188352 00000100:00100000:3.0:1783349759.070959:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:3.0:1783349759.070973:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655188608:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349759.070993:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00100000:0.0:1783349759.071004:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655188352:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349759.071045:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655188608:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.071054:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:0.0:1783349759.071074:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655188352:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 72us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.071097:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00080000:2.0:1783349759.071165:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349759.078367:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349759.078479:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349759.078576:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188736 00000100:00100000:3.0:1783349759.078586:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188736 00000100:00100000:3.0:1783349759.078658:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:3.0:1783349759.078668:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655188736:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349759.078755:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655188736:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349759.078763:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00080000:2.0:1783349759.078984:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349759.079062:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188480 00000100:00100000:1.0:1783349759.079066:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188480 00000100:00100000:1.0:1783349759.079257:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:1.0:1783349759.079265:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655188480:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349759.079330:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655188480:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 65us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349759.079337:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00080000:2.0:1783349759.079747:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349759.338079:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349759.338105:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666750720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349759.338182:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349759.338454:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750720 00000100:00100000:0.0:1783349759.338462:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750720 00000100:00100000:0.0:1783349759.338523:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783349759.338535:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666750720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349759.338583:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349759.338698:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666750720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349759.338707:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783349759.338867:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba3100 x1869977666750720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349759.338886:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666750720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349759.660993:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349759.823241:0:9183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.84 00010000:00010000:2.0:1783349760.682206:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349761.398576:0:9280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.84 00010000:00010000:3.0:1783349761.712008:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349762.410060:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666750848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349762.410127:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349762.410269:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750848 00000100:00100000:1.0:1783349762.410276:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750848 00000100:00100000:1.0:1783349762.410349:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349762.410359:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666750848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349762.410394:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349762.410460:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666750848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349762.410467:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783349762.410520:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a12300 x1869977666750848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349762.410539:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666750848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783349762.410604:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1783349762.464462:0:9328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 6 10:56:00 EDT 2026 00010000:00010000:3.0:1783349762.730162:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349763.754590:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349763.947586:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666751104:0@lo:400:kworker.0 00000100:00100000:1.0:1783349763.947662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349763.947728:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666751232:0@lo:400:kworker.0 00000100:00100000:1.0:1783349763.947730:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666751616:0@lo:400:kworker.0 00000100:00100000:1.0:1783349763.947776:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349763.947780:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349763.947843:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783349763.947845:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349763.947854:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666750976:0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.947857:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666751360:0@lo:400:kworker.0 00000100:00100000:1.0:1783349763.947906:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349763.947907:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349763.947945:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666751488:0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.947962:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751104 00000100:00100000:0.0:1783349763.947971:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751104 00000100:00100000:1.0:1783349763.947976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349763.948017:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751232 00000100:00100000:1.0:1783349763.948020:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751488 00000100:00100000:0.0:1783349763.948021:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751232 00000100:00100000:1.0:1783349763.948027:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751488 00000100:00100000:0.0:1783349763.948059:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783349763.948067:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349763.948072:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666751104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349763.948079:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666751232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.948127:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666751104:12345-0@lo:400:kworker.0 Request processed in 59us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349763.948141:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783349763.948157:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783349763.948164:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666751488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.948193:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666751488:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349763.948198:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349763.948212:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666751488:0@lo:400:kworker.0 00000100:00100000:2.0:1783349763.948225:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666751104:0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.948225:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751616 00000100:00100000:0.0:1783349763.948228:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751616 00000100:00080000:2.0:1783349763.948250:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349763.948251:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751360 00000100:00100000:0.0:1783349763.948254:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751360 00000100:00080000:2.0:1783349763.948255:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349763.948270:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783349763.948275:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666751616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.948311:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666751616:12345-0@lo:400:kworker.0 Request processed in 35us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349763.948318:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783349763.948333:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666751360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349763.948373:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666751360:12345-0@lo:400:kworker.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349763.948431:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666751232:12345-0@lo:400:kworker.0 Request processed in 355us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349763.948438:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783349763.948457:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666750976 00000100:00100000:0.0:1783349763.948459:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349763.948472:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666750976 00000100:00100000:2.0:1783349763.948481:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783349763.948508:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1783349763.948517:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3294:x1869977666750976:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783349763.948523:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba0e00 x1869977666751616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783349763.948523:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba1880 x1869977666751360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349763.948536:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666751616:0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.948536:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666751360:0@lo:400:kworker.0 00000100:00100000:0.0:1783349763.948546:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666751232:0@lo:400:kworker.0 00000100:00100000:1.0:1783349763.948669:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3294:x1869977666750976:12345-0@lo:400:kworker.0 Request processed in 154us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349763.948727:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783349763.948743:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666750976:0@lo:400:kworker.0 00000100:00100000:2.0:1783349764.192563:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349764.192620:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349764.192738:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188864 00000100:00100000:0.0:1783349764.192750:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188864 00000100:00100000:0.0:1783349764.192841:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:0.0:1783349764.192852:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655188864:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349764.192925:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2362:x1869977655188864:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 75us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349764.192950:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:1.0:1783349764.193347:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655188992 00000100:00100000:1.0:1783349764.193354:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655188992 00000100:00100000:1.0:1783349764.193406:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:1.0:1783349764.193414:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655188992:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:2.0:1783349764.193418:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349764.193472:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655188992:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 59us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349764.193479:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:0.0:1783349764.198717:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349764.198773:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349764.199374:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189120 00000100:00100000:3.0:1783349764.199387:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189120 00000100:00100000:1.0:1783349764.199475:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189248 00000100:00100000:1.0:1783349764.199481:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189248 00000100:00100000:2.0:1783349764.199590:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:2.0:1783349764.199605:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2358:x1869977655189120:12345-192.168.204.36@tcp:9:kworker.0 00000100:00080000:0.0:1783349764.199647:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1783349764.199655:0:6579:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476211 00000100:00080000:0.0:1783349764.199655:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349764.199672:0:6579:0:(import.c:65:import_set_state_nolock()) ffff931fc7b8c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783349764.199718:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1783349764.199724:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349764.199882:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:1.0:1783349764.199895:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2358:x1869977655189248:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:1.0:1783349764.199933:0:6580:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476218 00000100:00080000:1.0:1783349764.199946:0:6580:0:(import.c:65:import_set_state_nolock()) ffff931fc7d5e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349764.200010:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783349764.200253:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+2:2358:x1869977655189120:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 649us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349764.200262:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00010000:00010000:0.0:1783349764.200322:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349764.200570:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+2:2358:x1869977655189248:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 677us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349764.200579:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:2.0:1783349764.458248:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666751744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349764.458315:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349764.458450:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751744 00000100:00100000:3.0:1783349764.458470:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751744 00000100:00100000:3.0:1783349764.458535:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783349764.458546:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666751744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349764.458586:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349764.460111:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666751744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1561us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349764.460121:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1783349764.465589:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba3b80 x1869977666751744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349764.465618:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666751744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349764.778078:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349765.802979:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349766.826626:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349767.530005:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666751872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349767.530077:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349767.530197:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666751872 00000100:00100000:1.0:1783349767.530205:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666751872 00000100:00100000:1.0:1783349767.530270:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783349767.530279:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666751872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349767.530314:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349767.530356:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666751872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349767.530363:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1783349767.530430:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783349767.530468:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a13480 x1869977666751872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349767.530486:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666751872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783349767.850370:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783349768.076298:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:0.0:1783349768.076310:0:7491:0:(genops.c:906:class_export_put()) final put ffff931fc7d5d000/ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:2.0:1783349768.079359:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc7d5d000/ed421ea5-67f7-4096-abd5-85a5a23dfd60 for lustre-OST0001 00000020:00000080:2.0:1783349768.079482:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff931fc7d5e800 for lustre-OST0001 00000001:00100000:3.0:1783349768.084271:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:3.0:1783349768.084282:0:6607:0:(genops.c:906:class_export_put()) final put ffff931fc7b8a800/ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:0.0:1783349768.084362:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc7b8a800/ed421ea5-67f7-4096-abd5-85a5a23dfd60 for lustre-OST0000 00000020:00000080:0.0:1783349768.084566:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff931fc7b8c800 for lustre-OST0000 00010000:00010000:3.0:1783349768.875118:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349769.067564:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666752000:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.067655:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666752128:0@lo:400:kworker.0 00000100:00100000:2.0:1783349769.067687:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349769.067707:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349769.067762:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666752512:0@lo:400:kworker.0 00000100:00100000:2.0:1783349769.067789:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349769.067855:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752128 00000100:00100000:2.0:1783349769.067867:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752128 00000100:00100000:1.0:1783349769.067880:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666752640:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.067919:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349769.067934:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752512 00000100:00100000:2.0:1783349769.067938:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752512 00000100:00100000:1.0:1783349769.067959:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666752256:0@lo:400:kworker.0 00000100:00100000:2.0:1783349769.067987:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783349769.067992:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349769.068003:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666752128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.068009:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349769.068016:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666752384:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.068052:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349769.068081:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666752128:12345-0@lo:400:kworker.0 Request processed in 80us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349769.068091:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783349769.068095:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752000 00000100:00100000:1.0:1783349769.068100:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752000 00000100:00100000:2.0:1783349769.068116:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752256 00000100:00100000:2.0:1783349769.068121:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752256 00000100:00100000:1.0:1783349769.068140:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783349769.068153:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783349769.068154:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666752000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349769.068165:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666752512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.068209:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666752000:12345-0@lo:400:kworker.0 Request processed in 60us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349769.068220:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783349769.068221:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666752512:12345-0@lo:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349769.068230:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783349769.068249:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783349769.068257:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666752256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.068263:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752640 00000100:00100000:1.0:1783349769.068270:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752640 00000100:00100000:1.0:1783349769.068300:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752384 00000100:00100000:1.0:1783349769.068303:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752384 00000100:00100000:2.0:1783349769.068311:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666752256:12345-0@lo:400:kworker.0 Request processed in 56us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349769.068319:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1783349769.068347:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349769.068352:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349769.069361:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349769.069383:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666752640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.069444:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666752640:12345-0@lo:400:kworker.0 Request processed in 63us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349769.069451:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349769.069464:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349769.069470:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666752384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.069499:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666752384:12345-0@lo:400:kworker.0 Request processed in 29us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349769.069505:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783349769.069598:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a10000 x1869977666752384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349769.069616:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666752384:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.069631:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666752256:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.069688:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666752128:0@lo:400:kworker.0 00010000:00080000:1.0:1783349769.069701:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c1180 x1869977666752640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349769.069710:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666752640:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.069745:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666752512:0@lo:400:kworker.0 00000100:00100000:1.0:1783349769.069757:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666752000:0@lo:400:kworker.0 00000100:00080000:3.0:1783349769.070318:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349769.314666:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349769.314735:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349769.315458:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189504 00000100:00100000:2.0:1783349769.315550:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189504 00000100:00100000:2.0:1783349769.315647:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:2.0:1783349769.315659:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2360:x1869977655189504:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349769.315759:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2360:x1869977655189504:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 103us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349769.315848:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:2.0:1783349769.315881:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189376 00000100:00100000:2.0:1783349769.315886:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189376 00000100:00100000:2.0:1783349769.315917:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:2.0:1783349769.315924:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2360:x1869977655189376:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349769.315954:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2360:x1869977655189376:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349769.315962:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00080000:2.0:1783349769.315992:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349769.577956:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349769.577988:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666752768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349769.578101:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349769.578194:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752768 00000100:00100000:2.0:1783349769.578980:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752768 00000100:00100000:2.0:1783349769.579068:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349769.579078:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666752768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349769.579128:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349769.579197:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666752768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349769.579204:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783349769.579275:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320ec483100 x1869977666752768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349769.579311:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666752768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783349769.897937:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349770.923316:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349771.947968:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349772.431957:0:9960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:56:10 (1783349770) === 00000100:00100000:2.0:1783349772.650051:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666752896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349772.650125:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349772.650263:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666752896 00000100:00100000:0.0:1783349772.650271:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666752896 00000100:00100000:0.0:1783349772.650368:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783349772.650618:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666752896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349772.650654:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349772.650788:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666752896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 342us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349772.650820:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1783349772.652152:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783349772.652608:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c1180 x1869977666752896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349772.652633:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666752896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349772.832146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.832273:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189632 00000100:00100000:1.0:1783349772.832283:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189632 00000100:00100000:1.0:1783349772.832356:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:1.0:1783349772.832368:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:8102:x1869977655189632:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783349772.832392:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349772.832410:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb600/0x68b4a22a484762dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b8e1 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349772.832439:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb600/0x68b4a22a484762dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8e1 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349772.832451:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb600/0x68b4a22a484762dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8e1 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349772.832461:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb600, rc 0) 00000100:00100000:1.0:1783349772.832530:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8102:x1869977655189632:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 165us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.832553:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:2.0:1783349772.837438:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.837525:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189760 00000100:00100000:1.0:1783349772.837534:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189760 00000100:00100000:1.0:1783349772.837585:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:1.0:1783349772.837593:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8102:x1869977655189760:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783349772.837950:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8102:x1869977655189760:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 357us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.837958:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:0.0:1783349772.843559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349772.843667:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655189888 00000100:00100000:3.0:1783349772.843678:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655189888 00000100:00100000:3.0:1783349772.843770:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:3.0:1783349772.843781:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8102:x1869977655189888:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783349772.844080:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8102:x1869977655189888:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 300us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.844089:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:3.0:1783349772.846224:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.846410:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190016 00000100:00100000:1.0:1783349772.846418:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190016 00000100:00100000:1.0:1783349772.846470:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:1.0:1783349772.846480:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8106:x1869977655190016:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349772.846748:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8106:x1869977655190016:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 269us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.846756:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:2.0:1783349772.860011:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349772.860116:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190144 00000100:00100000:3.0:1783349772.860128:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190144 00000100:00100000:3.0:1783349772.860184:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:3.0:1783349772.860194:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8106:x1869977655190144:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783349772.863439:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8106:x1869977655190144:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 3236us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.863453:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:2.0:1783349772.866601:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349772.866846:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190272 00000100:00100000:0.0:1783349772.866856:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190272 00000100:00100000:0.0:1783349772.866905:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:0.0:1783349772.866915:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:8102:x1869977655190272:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783349772.866931:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349772.866948:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175be00/0x68b4a22a484762e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b90b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349772.866974:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175be00/0x68b4a22a484762e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b90b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349772.866983:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175be00/0x68b4a22a484762e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b90b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349772.866991:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175be00, rc 0) 00000100:00100000:0.0:1783349772.867035:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:8102:x1869977655190272:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349772.867041:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:2.0:1783349772.869758:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349772.870119:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190400 00000100:00100000:3.0:1783349772.870128:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190400 00000100:00100000:3.0:1783349772.870171:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:3.0:1783349772.870181:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:8102:x1869977655190400:12345-192.168.204.36@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783349772.870211:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783349772.870246:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783349772.870251:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783349772.870253:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783349772.870256:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1783349772.872170:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:8102:x1869977655190400:12345-192.168.204.36@tcp:256:mount.lustre.0 Request processed in 1980us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.872195:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:2.0:1783349772.875695:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.875838:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190528 00000100:00100000:1.0:1783349772.875849:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190528 00000100:00100000:1.0:1783349772.875947:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:1.0:1783349772.875957:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:8102:x1869977655190528:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783349772.875974:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349772.875992:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b912 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349772.876019:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349772.876058:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349772.876067:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacbe00, rc 0) 00000100:00100000:1.0:1783349772.876123:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8102:x1869977655190528:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 168us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.876130:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:2.0:1783349772.879111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349772.879197:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190656 00000100:00100000:3.0:1783349772.879206:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190656 00000100:00100000:3.0:1783349772.879258:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:3.0:1783349772.879267:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8102:x1869977655190656:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783349772.879779:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8102:x1869977655190656:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 510us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.879788:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:2.0:1783349772.888090:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.888152:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190784 00000100:00100000:1.0:1783349772.888162:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190784 00000100:00100000:1.0:1783349772.888211:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:1.0:1783349772.888220:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8102:x1869977655190784:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783349772.888530:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8102:x1869977655190784:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 310us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.888538:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:2.0:1783349772.892167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349772.892330:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655190912 00000100:00100000:0.0:1783349772.892341:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655190912 00000100:00100000:0.0:1783349772.892407:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:0.0:1783349772.892417:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8108:x1869977655190912:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349772.892673:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8108:x1869977655190912:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 258us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349772.892679:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:2.0:1783349772.894962:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.895101:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191040 00000100:00100000:1.0:1783349772.895111:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191040 00000100:00100000:1.0:1783349772.895159:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:1.0:1783349772.895168:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8108:x1869977655191040:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349772.895419:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:8108:x1869977655191040:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 251us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.895427:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:2.0:1783349772.899625:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349772.899672:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349772.899770:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191296 00000100:00100000:0.0:1783349772.899822:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191296 00000100:00100000:0.0:1783349772.899942:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191168 00000100:00100000:0.0:1783349772.899946:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191168 00000100:00080000:2.0:1783349772.900023:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349772.900158:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:3.0:1783349772.900169:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655191296:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349772.900287:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655191296:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 120us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.900305:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:3.0:1783349772.900325:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:3.0:1783349772.900329:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1869977655191168:12345-192.168.204.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783349772.900352:0:5784:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 48a60ae5-4060-4be4-9464-772b1677edda@192.168.204.36@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1783349772.900393:0:5784:0:(genops.c:1406:class_connect()) connect: client 48a60ae5-4060-4be4-9464-772b1677edda, cookie 0x68b4a22a484762f1 00000004:00100000:3.0:1783349772.900423:0:5784:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783349772.900710:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9320c86b2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349772.900741:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+6:2358:x1869977655191168:12345-192.168.204.36@tcp:38:mount.lustre.0 Request processed in 409us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.900748:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:2.0:1783349772.903583:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349772.903625:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349772.904540:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191424 00000100:00100000:0.0:1783349772.904552:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191424 00000100:00100000:0.0:1783349772.904641:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191552 00000100:00100000:0.0:1783349772.904645:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191552 00000100:00100000:0.0:1783349772.904673:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349772.904682:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+7:0:x1869977655191424:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783349772.904731:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783349772.904838:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+7:0:x1869977655191424:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 157us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349772.904846:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349772.904867:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00080000:2.0:1783349772.904869:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349772.904876:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+6:8102:x1869977655191552:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783349772.904889:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783349772.904912:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+6:8102:x1869977655191552:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 39us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349772.904919:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:2.0:1783349772.909929:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.910053:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191680 00000100:00100000:1.0:1783349772.910063:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191680 00000100:00100000:1.0:1783349772.910126:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:1.0:1783349772.910136:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:8102:x1869977655191680:12345-192.168.204.36@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783349772.910250:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:8102:x1869977655191680:12345-192.168.204.36@tcp:40:mount.lustre.0 Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349772.910258:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:1.0:1783349772.916387:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.916439:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349772.916482:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349772.916584:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191808 00000100:00100000:3.0:1783349772.916611:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191808 00000100:00100000:3.0:1783349772.916655:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655191936 00000100:00100000:3.0:1783349772.916659:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655191936 00000100:00100000:3.0:1783349772.916682:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:3.0:1783349772.916690:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1869977655191808:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783349772.916721:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 48a60ae5-4060-4be4-9464-772b1677edda@192.168.204.36@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1783349772.916750:0:6578:0:(genops.c:1406:class_connect()) connect: client 48a60ae5-4060-4be4-9464-772b1677edda, cookie 0x68b4a22a484762f8 00002000:00100000:3.0:1783349772.916762:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 48a60ae5-4060-4be4-9464-772b1677edda/ffff9320c86b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783349772.916775:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783349772.916846:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:2.0:1783349772.916852:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1869977655191936:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783349772.916868:0:7807:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 48a60ae5-4060-4be4-9464-772b1677edda@192.168.204.36@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1783349772.916887:0:7807:0:(genops.c:1406:class_connect()) connect: client 48a60ae5-4060-4be4-9464-772b1677edda, cookie 0x68b4a22a484762ff 00002000:00100000:2.0:1783349772.916892:0:7807:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48a60ae5-4060-4be4-9464-772b1677edda/ffff9320d155a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783349772.916908:0:7807:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783349772.917032:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783349772.917060:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9320c86b7000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1783349772.917121:0:7807:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1783349772.917122:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48a60ae5-4060-4be4-9464-772b1677edda+6:2358:x1869977655191808:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 431us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349772.917129:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00080000:2.0:1783349772.917134:0:7807:0:(import.c:65:import_set_state_nolock()) ffff9320d155d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349772.917158:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:2358:x1869977655191936:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 304us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349772.917164:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:0.0:1783349772.917383:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192064 00000100:00100000:0.0:1783349772.917389:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192064 00000100:00100000:0.0:1783349772.917433:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:0.0:1783349772.917441:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48a60ae5-4060-4be4-9464-772b1677edda+6:8102:x1869977655192064:12345-192.168.204.36@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783349772.917629:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783349772.917755:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48a60ae5-4060-4be4-9464-772b1677edda+6:8102:x1869977655192064:12345-192.168.204.36@tcp:33:mount.lustre.0 Request processed in 314us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349772.917763:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1 00010000:00010000:0.0:1783349772.969984:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349773.202419:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 48a60ae5-4060-4be4-9464-772b1677edda 00000001:00100000:2.0:1783349773.209209:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48a60ae5-4060-4be4-9464-772b1677edda 00000001:00100000:3.0:1783349773.211683:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48a60ae5-4060-4be4-9464-772b1677edda 00010000:00010000:1.0:1783349773.993972:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349774.186243:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666753280:0@lo:400:kworker.0 00000100:00100000:3.0:1783349774.186354:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349774.186408:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349774.186414:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666753408:0@lo:400:kworker.0 00000100:00100000:3.0:1783349774.186446:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349774.186588:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753408 00000100:00100000:3.0:1783349774.186596:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753408 00000100:00100000:3.0:1783349774.186655:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783349774.186666:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666753408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349774.186722:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666753408:12345-0@lo:400:kworker.0 Request processed in 58us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349774.186778:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1783349774.186832:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783349774.186875:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7181500 x1869977666753408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349774.186889:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666753408:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.187817:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666753024:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.187863:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349774.187895:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666753536:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.187919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349774.187940:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783349774.187946:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666753152:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.187963:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349774.187981:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666753664:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188002:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349774.188032:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753024 00000100:00100000:2.0:1783349774.188038:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753024 00000100:00100000:2.0:1783349774.188076:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783349774.188083:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666753024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188126:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666753024:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349774.188132:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783349774.188163:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753280 00000100:00100000:2.0:1783349774.188167:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753280 00000100:00100000:2.0:1783349774.188196:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753536 00000100:00100000:2.0:1783349774.188199:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753536 00000100:00100000:2.0:1783349774.188212:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753152 00000100:00100000:2.0:1783349774.188214:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753152 00000100:00100000:2.0:1783349774.188228:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349774.188234:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666753280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188283:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666753280:12345-0@lo:400:kworker.0 Request processed in 48us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349774.188289:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349774.188302:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349774.188308:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666753536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188336:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666753536:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349774.188342:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349774.188352:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349774.188357:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666753152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188381:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666753152:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349774.188387:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349774.188407:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753664 00000100:00100000:2.0:1783349774.188415:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753664 00000100:00100000:2.0:1783349774.188442:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349774.188448:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666753664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188479:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666753664:12345-0@lo:400:kworker.0 Request processed in 31us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349774.188485:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1783349774.188505:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349774.188508:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349774.188531:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666753152:0@lo:400:kworker.0 00010000:00080000:2.0:1783349774.188543:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7182d80 x1869977666753664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349774.188553:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666753664:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188561:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666753024:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188570:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666753536:0@lo:400:kworker.0 00000100:00100000:2.0:1783349774.188606:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666753280:0@lo:400:kworker.0 00000100:00100000:3.0:1783349774.702350:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666753792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349774.702428:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349774.702527:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753792 00000100:00100000:1.0:1783349774.702535:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753792 00000100:00100000:1.0:1783349774.702597:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349774.702607:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666753792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349774.702644:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349774.702699:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666753792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349774.702706:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783349774.702973:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba1500 x1869977666753792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349774.702994:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666753792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783349775.019564:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349776.042883:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349776.429254:0:10154:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1783349777.066026:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349777.770108:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666753920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349777.770181:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349777.770253:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666753920 00000100:00100000:0.0:1783349777.770261:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666753920 00000100:00100000:0.0:1783349777.770365:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783349777.770377:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666753920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349777.770407:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349777.770456:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666753920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349777.770463:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1783349777.770514:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c0e00 x1869977666753920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349777.770532:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666753920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783349777.772289:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349778.011446:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349778.011494:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349778.011567:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192192 00000100:00100000:2.0:1783349778.011577:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192192 00000100:00100000:2.0:1783349778.011638:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:2.0:1783349778.011647:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655192192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349778.011725:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655192192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349778.011733:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:3.0:1783349778.011838:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192320 00000100:00100000:3.0:1783349778.011843:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192320 00000100:00100000:3.0:1783349778.011882:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:3.0:1783349778.011890:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655192320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1783349778.011925:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349778.011926:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655192320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349778.011935:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:2.0:1783349778.012937:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349778.013040:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349778.013103:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192704 00000100:00100000:1.0:1783349778.013110:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192704 00000100:00100000:1.0:1783349778.013161:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:1.0:1783349778.013170:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655192704:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349778.013229:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655192704:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349778.013242:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00080000:2.0:1783349778.013347:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349778.013522:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192448 00000100:00100000:3.0:1783349778.013527:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192448 00000100:00100000:3.0:1783349778.013598:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:3.0:1783349778.013605:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655192448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1783349778.013672:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349778.013710:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655192448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 105us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349778.013724:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:2.0:1783349778.013861:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349778.013928:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192576 00000100:00100000:2.0:1783349778.013932:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192576 00000100:00100000:2.0:1783349778.013973:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:2.0:1783349778.013983:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655192576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349778.014021:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655192576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349778.014028:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00080000:0.0:1783349778.014111:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783349778.092157:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349779.113895:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349779.312089:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666754304:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312164:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349779.312211:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754304 00000100:00100000:3.0:1783349779.312219:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754304 00000100:00100000:1.0:1783349779.312240:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349779.312249:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666754432:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312277:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349779.312281:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783349779.312293:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666754304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312319:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666754176:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312340:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349779.312353:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666754688:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312388:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349779.312419:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666754304:12345-0@lo:400:kworker.0 Request processed in 127us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349779.312420:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783349779.312432:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666754048:0@lo:400:kworker.0 00000100:00100000:3.0:1783349779.312433:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783349779.312455:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754176 00000100:00100000:3.0:1783349779.312460:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754176 00000100:00100000:1.0:1783349779.312471:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349779.312486:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783349779.312496:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666754176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312502:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb55b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666754560:0@lo:400:kworker.0 00000100:00100000:3.0:1783349779.312528:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666754176:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349779.312535:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349779.312582:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349779.312672:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666754176:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312704:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754432 00000100:00100000:1.0:1783349779.312708:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754432 00000100:00100000:1.0:1783349779.312742:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754688 00000100:00100000:1.0:1783349779.312745:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754688 00000100:00100000:1.0:1783349779.312769:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783349779.312776:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666754432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312834:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666754432:12345-0@lo:400:kworker.0 Request processed in 58us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349779.312847:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783349779.312861:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783349779.312866:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666754688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.312900:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666754688:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349779.312905:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783349779.312934:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754560 00000100:00100000:1.0:1783349779.312937:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754560 00000100:00100000:1.0:1783349779.312971:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783349779.312977:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666754560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.313004:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666754560:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349779.313010:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1783349779.313050:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba1500 x1869977666754432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349779.313061:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666754432:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.313071:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666754304:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.313094:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb55b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666754560:0@lo:400:kworker.0 00010000:00080000:1.0:1783349779.313104:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb558a80 x1869977666754688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349779.313113:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666754688:0@lo:400:kworker.0 00000100:00080000:1.0:1783349779.313305:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349779.313311:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349779.313319:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349779.313335:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754048 00000100:00100000:1.0:1783349779.313338:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754048 00000100:00100000:1.0:1783349779.313362:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783349779.313369:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3294:x1869977666754048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.313404:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3294:x1869977666754048:12345-0@lo:400:kworker.0 Request processed in 36us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349779.313410:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783349779.313450:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666754048:0@lo:400:kworker.0 00000100:00100000:1.0:1783349779.818098:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666754816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349779.818186:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349779.818357:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754816 00000100:00100000:2.0:1783349779.818366:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754816 00000100:00100000:2.0:1783349779.818436:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349779.818446:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666754816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349779.818481:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349779.819190:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666754816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 743us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349779.819198:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1783349779.819475:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb559500 x1869977666754816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349779.819495:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666754816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783349780.146831:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349781.162234:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349782.185891:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349782.890915:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349782.890943:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666754944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349782.891036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349782.891123:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666754944 00000100:00100000:1.0:1783349782.891132:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666754944 00000100:00100000:1.0:1783349782.891213:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349782.891225:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666754944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349782.891277:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349782.891338:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666754944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349782.891356:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1783349782.891384:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783349782.891426:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c0380 x1869977666754944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349782.891448:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666754944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349783.133166:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349783.133215:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349783.133238:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192960 00000100:00100000:1.0:1783349783.133251:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192960 00000100:00100000:0.0:1783349783.133271:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349783.133302:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349783.133328:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193088 00000100:00100000:1.0:1783349783.133334:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193088 00000100:00100000:0.0:1783349783.133334:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349783.133364:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655192832 00000100:00100000:0.0:1783349783.133369:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655192832 00000100:00100000:1.0:1783349783.133372:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:1.0:1783349783.133384:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655192960:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349783.133406:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00100000:0.0:1783349783.133416:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655192832:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349783.133458:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655192832:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349783.133497:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193216 00000100:00080000:3.0:1783349783.133501:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349783.133504:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193216 00000100:00080000:3.0:1783349783.133532:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349783.133543:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193344 00000100:00100000:2.0:1783349783.133547:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193344 00000100:00100000:0.0:1783349783.133582:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00100000:0.0:1783349783.133614:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:0.0:1783349783.133620:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349783.133645:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1783349783.133653:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:3.0:1783349783.133677:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349783.134010:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:3.0:1783349783.134019:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193344:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349783.134759:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655192960:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1374us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349783.134768:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:0.0:1783349783.135425:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1802us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349783.135434:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:3.0:1783349783.135499:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1478us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349783.135509:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:2.0:1783349783.136009:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2354us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349783.136018:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 30 00010000:00010000:2.0:1783349783.212725:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349784.233940:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349784.426061:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666755328:0@lo:400:kworker.0 00000100:00100000:1.0:1783349784.426116:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666755072:0@lo:400:kworker.0 00000100:00100000:3.0:1783349784.426221:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666755200:0@lo:400:kworker.0 00000100:00100000:2.0:1783349784.427271:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666755456:0@lo:400:kworker.0 00000100:00100000:0.0:1783349784.427351:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349784.427396:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349784.427426:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349784.427474:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666755712:0@lo:400:kworker.0 00000100:00100000:0.0:1783349784.427489:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755328 00000100:00100000:0.0:1783349784.427496:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755328 00000100:00100000:3.0:1783349784.427507:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349784.427530:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755072 00000100:00100000:2.0:1783349784.427535:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755072 00000100:00100000:0.0:1783349784.427554:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755200 00000100:00100000:0.0:1783349784.427557:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755200 00000100:00100000:3.0:1783349784.427561:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349784.427570:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783349784.427571:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666755584:0@lo:400:kworker.0 00000100:00100000:2.0:1783349784.427584:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666755072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349784.427600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349784.427635:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755584 00000100:00100000:3.0:1783349784.427639:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755584 00000100:00100000:3.0:1783349784.427662:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349784.427667:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666755328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349784.427723:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349784.427731:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666755584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349784.427774:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666755072:12345-0@lo:400:kworker.0 Request processed in 193us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349784.427782:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783349784.428267:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666755328:12345-0@lo:400:kworker.0 Request processed in 597us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349784.428274:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349784.428290:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783349784.428296:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666755200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349784.428328:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666755200:12345-0@lo:400:kworker.0 Request processed in 32us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349784.428333:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783349784.428350:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755712 00000100:00100000:3.0:1783349784.428354:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755712 00000100:00100000:3.0:1783349784.428382:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349784.428388:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666755712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349784.428416:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666755712:12345-0@lo:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349784.428422:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349784.428588:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349784.428623:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755456 00000100:00100000:3.0:1783349784.428626:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755456 00000100:00100000:3.0:1783349784.428660:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783349784.428665:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666755456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349784.428701:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666755456:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349784.428707:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1783349784.428741:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faca3b80 x1869977666755456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349784.428754:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666755456:0@lo:400:kworker.0 00010000:00080000:3.0:1783349784.428781:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f7ae1880 x1869977666755712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349784.428807:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666755712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349784.428832:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666755200:0@lo:400:kworker.0 00000100:00100000:1.0:1783349784.429207:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666755072:0@lo:400:kworker.0 00000100:00080000:1.0:1783349784.429275:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349784.429279:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349784.429282:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349784.429313:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666755328:0@lo:400:kworker.0 00000100:00100000:0.0:1783349784.430258:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666755584:12345-0@lo:400:kworker.0 Request processed in 2523us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349784.430269:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349784.430317:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666755584:0@lo:400:kworker.0 00000100:00100000:1.0:1783349784.939710:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666755840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349784.939778:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349784.939923:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755840 00000100:00100000:2.0:1783349784.939932:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755840 00000100:00100000:1.0:1783349784.940144:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783349784.940154:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666755840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349784.940189:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349784.940281:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666755840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349784.940288:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1783349784.940350:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb559f80 x1869977666755840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349784.940368:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666755840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783349785.257941:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349786.282139:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349786.287274:0:10855:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783349787.306064:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349788.009999:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349788.010037:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666755968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349788.010127:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349788.010904:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666755968 00000100:00100000:1.0:1783349788.010914:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666755968 00000100:00100000:1.0:1783349788.010996:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783349788.011015:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666755968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349788.011057:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349788.011136:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666755968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349788.011143:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1783349788.011244:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c0e00 x1869977666755968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349788.011268:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666755968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783349788.013014:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349788.252626:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349788.252990:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349788.253038:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349788.253059:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193728 00000100:00100000:3.0:1783349788.253074:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193728 00000100:00100000:2.0:1783349788.253108:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349788.253174:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193600 00000100:00100000:3.0:1783349788.253178:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193600 00000100:00100000:3.0:1783349788.253209:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:2.0:1783349788.253209:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349788.253225:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349788.253242:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193984 00000100:00100000:2.0:1783349788.253247:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193984 00000100:00100000:2.0:1783349788.253284:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193856 00000100:00100000:2.0:1783349788.253287:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193856 00000100:00100000:2.0:1783349788.253311:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:2.0:1783349788.253319:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349788.253339:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.253354:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655193984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.253373:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:1.0:1783349788.253377:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655193472 00000100:00100000:1.0:1783349788.253383:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655193472 00000100:00100000:2.0:1783349788.253394:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:2.0:1783349788.253403:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655193856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349788.253433:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655193856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349788.253441:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 211 00000100:00100000:2.0:1783349788.253442:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:1.0:1783349788.253456:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655193472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349788.253516:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:0.0:1783349788.253528:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655193600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349788.253562:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655193472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 110us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349788.253568:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655193600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349788.253576:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 211 00000100:00100000:0.0:1783349788.253579:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00080000:0.0:1783349788.253608:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349788.253613:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349788.253616:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349788.253711:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00010000:00010000:0.0:1783349788.329918:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349788.531079:0:11002:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7c46e9b0 20000000:00000080:0.0:1783349788.531095:0:11002:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9320f72cdc00 uarg=0000000000000000 20000000:01000000:0.0:1783349788.531127:0:11002:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783349788.531132:0:11002:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783349788.531136:0:11002:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783349788.531968:0:11003:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783349788.532050:0:11002:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783349788.538128:0:11002:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783349788.538165:0:11002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538202:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484762ab expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538210:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538218:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538227:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538235:0:11002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538243:0:11002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538290:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538309:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 12 pid: 5777 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.538326:0:11002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756096:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349788.538452:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538462:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 12 pid: 5778 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.538478:0:11002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756224:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349788.538517:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538525:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.538533:0:11002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756352:0@lo:104: 00000100:00100000:1.0:1783349788.538568:0:11002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349788.538601:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538608:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.538622:0:11002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756480:0@lo:104: 00000100:00100000:1.0:1783349788.538644:0:11002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783349788.538688:0:11002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484762ab expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.538696:0:11002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484762ab expref: 18 pid: 5778 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.538705:0:11002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756608:0@lo:104: 00000100:00100000:1.0:1783349788.538726:0:11002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349788.538739:0:11002:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349788.538824:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666756352 00000100:00100000:2.0:1783349788.538832:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666756352 00000100:00100000:2.0:1783349788.538871:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666756480 00000100:00100000:2.0:1783349788.538874:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666756480 00000100:00100000:2.0:1783349788.538885:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666756608 00000100:00100000:2.0:1783349788.538887:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666756608 00000100:00100000:2.0:1783349788.538899:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349788.538908:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:11002:x1869977666756352:12345-0@lo:104: 00010000:00010000:2.0:1783349788.538919:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.539093:0:11002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756352:0@lo:104: 00010000:00010000:2.0:1783349788.539125:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349788.539133:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+5:11002:x1869977666756352:12345-0@lo:104: Request processed in 226us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.539141:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349788.539159:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349788.539165:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:11002:x1869977666756480:12345-0@lo:104: 00010000:00010000:2.0:1783349788.539173:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.539251:0:11002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756480:0@lo:104: 00010000:00010000:0.0:1783349788.539293:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783349788.539299:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539307:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002800 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349788.539310:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539319:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349788.539336:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349788.539342:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783349788.539412:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539420:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349788.539441:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539449:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9002800/0x68b4a22a484762c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762ce expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539463:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349788.539467:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539472:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349788.539475:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.539482:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349788.539489:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349788.539494:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349788.539530:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783349788.539540:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:11002:x1869977666756480:12345-0@lo:104: Request processed in 376us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.539546:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349788.539560:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349788.539566:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:11002:x1869977666756608:12345-0@lo:104: 00010000:00010000:2.0:1783349788.539574:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.539612:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349788.539617:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:11002:x1869977666756608:12345-0@lo:104: Request processed in 52us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349788.539623:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1783349788.539914:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349788.539919:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.539925:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175b800 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349788.539928:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.539934:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349788.539940:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349788.539946:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1783349788.540033:0:11002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756608:0@lo:104: 00010000:00010000:3.0:1783349788.540055:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349788.540155:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349788.540170:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb55a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666756736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349788.540209:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349788.540272:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666756736 00000100:00100000:3.0:1783349788.540278:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666756736 00010000:00010000:3.0:1783349788.540303:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.540317:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.540325:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783349788.540329:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783349788.540338:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3294:x1869977666756736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349788.540340:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.540349:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fac97c00/0x68b4a22a484762b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762c0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540351:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349788.540361:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.540363:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349788.540366:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349788.540369:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349788.540376:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540390:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac96e00/0x68b4a22a484762ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484762c7 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540402:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349788.540427:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:3294:x1869977666756736:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.540433:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783349788.540605:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349788.540626:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349788.540640:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194112 00000100:00100000:3.0:1783349788.540643:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194112 00010000:00010000:3.0:1783349788.540658:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 13 pid: 5777 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349788.540675:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194240 00000100:00100000:3.0:1783349788.540677:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194240 00010000:00010000:3.0:1783349788.540686:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 14 pid: 5778 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349788.540707:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:3.0:1783349788.540713:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+14:2362:x1869977655194112:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349788.540721:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349788.540725:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 14 pid: 5777 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540735:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 14 pid: 5777 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540745:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349788.540777:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+14:2362:x1869977655194112:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.540782:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:3.0:1783349788.540815:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:3.0:1783349788.540822:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655194240:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349788.540829:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349788.540833:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 13 pid: 5778 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540841:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 13 pid: 5778 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.540849:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349788.540862:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655194240:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.540868:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:0.0:1783349788.541339:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666756864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349788.541370:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349788.541415:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb55a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666756736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349788.541464:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faacbe00/0x68b4a22a484762ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b912 expref: 12 pid: 5777 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349788.541474:0:11002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756096:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349788.541485:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faaca600/0x68b4a22a484762d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8da expref: 11 pid: 5778 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349788.541493:0:11002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11002:1869977666756224:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349788.541517:0:11002:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.541600:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.541617:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349788.541639:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.541647:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d175b800/0x68b4a22a484762ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484762b2 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349788.541661:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349788.541663:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349788.541665:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349788.541830:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666756992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349788.541864:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349788.541929:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666756864 00000100:00100000:1.0:1783349788.541935:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666756864 00010000:00010000:1.0:1783349788.541955:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.541982:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666756992 00000100:00100000:1.0:1783349788.541985:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666756992 00010000:00010000:1.0:1783349788.542007:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484762ab expref: 19 pid: 5778 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349788.542021:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783349788.542028:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3294:x1869977666756864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783349788.542039:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349788.542044:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.542054:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.542065:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9002c00/0x68b4a22a484762c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484762b9 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349788.542074:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349788.542110:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:3294:x1869977666756864:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349788.542117:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783349788.542131:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349788.542142:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3291:x1869977666756992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349788.542150:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349788.542155:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484762ab expref: 17 pid: 5778 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542165:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484762ab expref: 17 pid: 5778 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542176:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac96000/0x68b4a22a484762b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484762ab expref: 17 pid: 5778 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349788.542187:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666756864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349788.542188:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542202:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542218:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542225:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542232:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542238:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542243:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349788.542254:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542262:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542285:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349788.542296:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349788.542307:0:11002:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.542317:0:11002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349788.542324:0:11002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faacb000/0x68b4a22a48476306 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349788.542338:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3291:x1869977666756992:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349788.542345:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783349788.543129:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666756992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349789.355152:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349789.545959:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666757504:0@lo:400:kworker.0 00000100:00100000:1.0:1783349789.545986:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666757120:0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.546525:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349789.546600:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666757248:0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.546630:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349789.546656:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fadeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666757760:0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.546679:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349789.546709:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349789.546716:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fadea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666757376:0@lo:400:kworker.0 00000100:00100000:0.0:1783349789.546845:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757504 00000100:00100000:0.0:1783349789.546854:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757504 00000100:00100000:0.0:1783349789.546901:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757760 00000100:00100000:0.0:1783349789.546905:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757760 00000100:00100000:0.0:1783349789.546938:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783349789.546947:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666757504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.546958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349789.547003:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757248 00000100:00100000:2.0:1783349789.547007:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757248 00000100:00100000:0.0:1783349789.547020:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666757504:12345-0@lo:400:kworker.0 Request processed in 74us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349789.547028:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783349789.547035:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757376 00000100:00100000:2.0:1783349789.547038:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757376 00000100:00100000:0.0:1783349789.547047:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783349789.547052:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666757760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.547061:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783349789.547068:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666757248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349789.547083:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666757760:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349789.547089:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783349789.547103:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666757248:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00080000:0.0:1783349789.547105:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349789.547109:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783349789.547109:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349789.547121:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783349789.547127:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666757376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.547154:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666757376:12345-0@lo:400:kworker.0 Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349789.547160:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783349789.547190:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783349789.547213:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fade9c00 x1869977666757504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349789.547221:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fadeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666757632:0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.547228:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666757504:0@lo:400:kworker.0 00000100:00100000:1.0:1783349789.547243:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349789.547256:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fadea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666757376:0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.547265:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666757248:0@lo:400:kworker.0 00000100:00100000:1.0:1783349789.547268:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757120 00000100:00100000:1.0:1783349789.547271:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757120 00010000:00080000:2.0:1783349789.547274:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fadeb480 x1869977666757760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349789.547282:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fadeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666757760:0@lo:400:kworker.0 00000100:00100000:1.0:1783349789.547296:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783349789.547301:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3292:x1869977666757120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.547309:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757632 00000100:00100000:2.0:1783349789.547312:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757632 00000100:00100000:1.0:1783349789.547332:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3292:x1869977666757120:12345-0@lo:400:kworker.0 Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349789.547334:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783349789.547339:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666757632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349789.547339:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783349789.547365:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666757632:12345-0@lo:400:kworker.0 Request processed in 25us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349789.547369:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666757120:0@lo:400:kworker.0 00000100:00100000:2.0:1783349789.547371:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783349789.547378:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fadeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666757632:0@lo:400:kworker.0 00000100:00080000:2.0:1783349789.547390:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349790.059372:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666757888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349790.059474:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349790.060123:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666757888 00000100:00100000:3.0:1783349790.060132:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666757888 00000100:00100000:3.0:1783349790.060194:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783349790.060204:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666757888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349790.060239:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349790.060297:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666757888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349790.060305:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783349790.060336:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb559c00 x1869977666757888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349790.060364:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666757888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349790.109064:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349790.109101:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194368 00000100:00100000:1.0:1783349790.109112:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194368 00000100:00100000:1.0:1783349790.109162:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:1.0:1783349790.109172:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:5568:x1869977655194368:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349790.109192:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349790.109213:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b93c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349790.109241:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349790.109253:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349790.109272:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca800, rc 0) 00000100:00100000:1.0:1783349790.109334:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655194368:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 163us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.109340:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:2.0:1783349790.112906:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349790.113018:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194496 00000100:00100000:1.0:1783349790.113032:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194496 00000100:00100000:1.0:1783349790.113084:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:1.0:1783349790.113096:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655194496:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349790.113662:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655194496:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 567us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.113672:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:0.0:1783349790.126492:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349790.126651:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194624 00000100:00100000:2.0:1783349790.126659:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194624 00000100:00100000:2.0:1783349790.126711:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:2.0:1783349790.126721:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655194624:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349790.126915:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655194624:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 196us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.126920:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:0.0:1783349790.131187:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349790.131323:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194752 00000100:00100000:2.0:1783349790.131332:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194752 00000100:00100000:2.0:1783349790.131385:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:2.0:1783349790.131396:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655194752:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349790.131412:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349790.131428:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b943 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349790.131454:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349790.131465:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349790.131477:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349790.131534:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655194752:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 140us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.131541:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:0.0:1783349790.134832:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349790.135017:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655194880 00000100:00100000:2.0:1783349790.135039:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655194880 00000100:00100000:2.0:1783349790.135096:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:2.0:1783349790.135106:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655194880:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349790.135392:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655194880:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 287us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.135400:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:0.0:1783349790.141012:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349790.141084:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195008 00000100:00100000:1.0:1783349790.141095:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195008 00000100:00100000:1.0:1783349790.141162:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:1.0:1783349790.141172:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655195008:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349790.141394:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655195008:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 222us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.141402:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 218 10000000:01000000:3.0:1783349790.315721:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349790.315729:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c970f800 from 7 10000000:01000000:3.0:1783349790.315735:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349790.315781:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.315809:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.315834:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349790.315860:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.315923:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.315999:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758016 00000100:00100000:0.0:1783349790.316007:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758016 00000100:00100000:0.0:1783349790.316090:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783349790.316099:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666758016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349790.316112:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349790.316124:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847631b expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.316145:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847631b expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.316156:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847631b expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.316164:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175a000, rc 0) 00000100:00100000:0.0:1783349790.316199:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666758016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.316272:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783349790.317071:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349790.317099:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349790.317116:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.317127:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349790.317184:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.317293:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349790.317324:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9780 going to sleep for 11 seconds 00000100:00100000:1.0:1783349790.317350:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758144 00000100:00100000:1.0:1783349790.317355:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758144 00000100:00100000:1.0:1783349790.317390:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783349790.317398:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666758144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349790.317730:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666758144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.317743:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783349790.318990:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.319036:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.319088:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349790.319124:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1783349790.319217:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758272 00000100:00100000:2.0:1783349790.319224:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758272 00000100:00100000:2.0:1783349790.319264:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783349790.319273:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666758272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349790.319472:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666758272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349790.319479:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783349790.319507:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783349790.320551:0:11137:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783349790.320829:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783349790.320849:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349790.320859:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.320875:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349790.320885:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349790.320888:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f70f3800 from 7 10000000:01000000:0.0:1783349790.320891:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349790.320919:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.320927:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.320937:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349790.320956:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349790.321011:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.321045:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349790.321538:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758400 00000100:00100000:1.0:1783349790.321544:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758400 00000100:00100000:1.0:1783349790.321590:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783349790.321599:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666758400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349790.321612:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349790.321625:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476329 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349790.321645:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476329 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349790.321655:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476329 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349790.321664:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb000, rc 0) 00000100:00100000:1.0:1783349790.321700:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666758400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.321706:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783349790.321941:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349790.321954:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.321973:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349790.322022:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349790.322048:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.322085:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349790.322252:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758528 00000100:00100000:1.0:1783349790.322256:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758528 00000100:00100000:1.0:1783349790.322280:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783349790.322286:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666758528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349790.322549:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666758528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.322564:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783349790.322653:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349790.322682:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349790.322716:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349790.322735:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349790.322826:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758656 00000100:00100000:1.0:1783349790.322832:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758656 00000100:00100000:1.0:1783349790.322861:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783349790.322867:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666758656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349790.323020:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666758656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.323027:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783349790.323296:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783349790.324221:0:11138:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783349790.324321:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783349790.324336:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349790.324568:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.324581:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349790.324621:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349790.324626:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c6fcb000 from 7 10000000:01000000:3.0:1783349790.324629:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349790.324659:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.324677:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.324687:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349790.324708:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.324760:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349790.324820:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349790.324829:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758784 00000100:00100000:0.0:1783349790.324837:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758784 00000100:00100000:3.0:1783349790.324903:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783349790.324912:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666758784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349790.324924:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349790.324935:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476337 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.324956:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476337 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.324978:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476337 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.324987:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002400, rc 0) 00000100:00100000:3.0:1783349790.325018:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666758784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349790.325025:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783349790.325027:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349790.325039:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.325048:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349790.325133:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.325157:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349790.325192:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349790.325277:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666758912 00000100:00100000:0.0:1783349790.325282:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666758912 00000100:00100000:0.0:1783349790.325304:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783349790.325311:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666758912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349790.325691:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7872850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666758912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 379us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349790.325699:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783349790.325717:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666758912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.325747:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666759040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349790.325783:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349790.325930:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349790.325995:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759040 00000100:00100000:1.0:1783349790.326000:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759040 00000100:00100000:1.0:1783349790.326032:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783349790.326039:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666759040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349790.326207:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7870050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666759040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349790.326214:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783349790.326266:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666759040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783349790.327393:0:11139:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783349790.328078:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783349790.328102:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783349790.328112:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349790.328124:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349790.377904:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349790.928536:0:11199:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783349791.401974:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349792.427249:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349793.130123:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666759168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349793.130228:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349793.130367:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759168 00000100:00100000:1.0:1783349793.130378:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759168 00000100:00100000:1.0:1783349793.130467:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783349793.130481:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666759168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349793.130529:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349793.130586:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666759168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349793.130595:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1783349793.130672:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783349793.130750:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320d6a10000 x1869977666759168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349793.130776:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666759168:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783349793.225040:0:11299:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:56:31 (1783349791) === 00000100:00100000:2.0:1783349793.375537:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.375589:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349793.375617:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195136 00000100:00100000:2.0:1783349793.375623:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349793.375633:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195136 00000100:00100000:0.0:1783349793.375713:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:0.0:1783349793.375724:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2362:x1869977655195136:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349793.375861:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195392 00000100:00100000:1.0:1783349793.375867:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195392 00000100:00100000:1.0:1783349793.375935:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195264 00000100:00100000:1.0:1783349793.375939:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195264 00000100:00100000:0.0:1783349793.375962:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2362:x1869977655195136:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349793.375973:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:1.0:1783349793.375978:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:1.0:1783349793.375987:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655195392:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349793.376031:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655195392:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349793.376038:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:1.0:1783349793.376056:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:1.0:1783349793.376065:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655195264:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349793.376095:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655195264:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349793.376101:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00080000:1.0:1783349793.376119:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349793.384655:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349793.384704:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349793.384786:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195520 00000100:00100000:0.0:1783349793.384830:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195520 00000100:00080000:1.0:1783349793.384927:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349793.385017:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195648 00000100:00100000:1.0:1783349793.385022:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195648 00000100:00100000:1.0:1783349793.385083:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:1.0:1783349793.385096:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48a60ae5-4060-4be4-9464-772b1677edda+5:2358:x1869977655195520:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:1.0:1783349793.385141:0:6580:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484762f8 00000100:00080000:1.0:1783349793.385152:0:6580:0:(import.c:65:import_set_state_nolock()) ffff9320c86b7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349793.385208:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783349793.385218:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:3.0:1783349793.385231:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2358:x1869977655195648:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:3.0:1783349793.385251:0:7807:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484762ff 00000100:00080000:3.0:1783349793.385280:0:7807:0:(import.c:65:import_set_state_nolock()) ffff9320d155d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783349793.385323:0:7807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1783349793.385476:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783349793.385523:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349793.385869:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48a60ae5-4060-4be4-9464-772b1677edda+2:2358:x1869977655195648:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 638us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349793.385879:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00010000:00010000:3.0:1783349793.385916:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349793.385919:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48a60ae5-4060-4be4-9464-772b1677edda+2:2358:x1869977655195520:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 825us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349793.385929:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:0.0:1783349793.391631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.398687:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655195776 00000100:00100000:2.0:1783349793.398711:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655195776 00000100:00100000:2.0:1783349793.398822:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:2.0:1783349793.398836:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:9651:x1869977655195776:12345-192.168.204.36@tcp:700:mkdir.0 00000100:00100000:2.0:1783349793.398981:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:9651:x1869977655195776:12345-192.168.204.36@tcp:700:mkdir.0 Request processed in 148us (7367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.398991:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:0.0:1783349793.403214:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349793.403335:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655196032 00000100:00100000:1.0:1783349793.403351:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655196032 00000100:00100000:1.0:1783349793.403432:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:1.0:1783349793.403445:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:9651:x1869977655196032:12345-192.168.204.36@tcp:36:mkdir.0 00010000:00010000:1.0:1783349793.403528:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349793.403569:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a48476226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8c5 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.403597:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349793.403611:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349793.405914:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.405941:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.405953:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.406082:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.406102:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.406116:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349793.407586:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783349793.407601:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.407620:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.407626:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.407632:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349793.407636:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.407643:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.407658:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320e0103700) 00010000:00010000:1.0:1783349793.407661:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349793.407666:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.407672:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476345 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349793.407690:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7e02631 reply state 0000000048d5eb91 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349793.407700:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349793.407833:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9651:x1869977655196032:12345-192.168.204.36@tcp:36:mkdir.0 Request processed in 4388us (4630us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783349793.407843:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00010000:00010000:3.0:1783349793.409875:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.409896:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.409914:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.409921:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.409926:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.409934:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.409956:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9320e0103600) 00010000:00010000:3.0:1783349793.409960:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349793.409965:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.409972:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a4847634c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349793.418161:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.418230:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655196160 00000100:00100000:2.0:1783349793.418244:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655196160 00000100:00100000:2.0:1783349793.418328:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:2.0:1783349793.418341:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:9652:x1869977655196160:12345-192.168.204.36@tcp:101:chmod.0 00010000:00010000:2.0:1783349793.418371:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349793.418406:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476353 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b94a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.418500:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a4847635a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.418519:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a4847635a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.418537:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a4847635a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349793.418627:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783349793.418632:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349793.418682:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a4847635a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.418718:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476353 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b94a expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.418741:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a4847635a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b94a expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.418751:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886a00) 00010000:00010000:2.0:1783349793.418754:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349793.418758:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96e00, rc 0) 00000100:00100000:2.0:1783349793.419234:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9652:x1869977655196160:12345-192.168.204.36@tcp:101:chmod.0 Request processed in 894us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.419256:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:0.0:1783349793.427258:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.427691:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655196416 00000100:00100000:2.0:1783349793.427705:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655196416 00000100:00100000:2.0:1783349793.427837:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349793.427850:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9652:x1869977655196416:12345-192.168.204.36@tcp:36:chmod.0 00010000:00010000:2.0:1783349793.427941:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349793.427976:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a4847635a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b94a expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.428003:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886a00) 00010000:00010000:2.0:1783349793.428016:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349793.428048:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.428062:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.428073:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349793.428486:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4c34ec5 reply state 0000000083dbc455 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349793.428498:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783349793.428514:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783349793.428751:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:9652:x1869977655196416:12345-192.168.204.36@tcp:36:chmod.0 Request processed in 901us (1505us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783349793.428760:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00010000:00010000:3.0:1783349793.431371:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.431413:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.431421:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.431428:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.431434:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.431443:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.431463:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:3.0:1783349793.431467:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349793.431472:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.431478:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476361 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.450351:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349793.462378:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349793.462777:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655196544 00000100:00100000:3.0:1783349793.462855:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655196544 00000100:00100000:3.0:1783349793.462966:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:3.0:1783349793.462980:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9653:x1869977655196544:12345-192.168.204.36@tcp:101:chown.0 00010000:00010000:3.0:1783349793.463031:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349793.463175:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b951 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.463358:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a4847636f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.463378:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a4847636f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.463392:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a4847636f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349793.463481:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783349793.463485:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349793.463534:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a4847636f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.463567:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b951 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.463590:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a4847636f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b951 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.463600:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320cf8b3100) 00010000:00010000:3.0:1783349793.463603:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349793.463608:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002800, rc 0) 00000100:00100000:3.0:1783349793.463696:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:9653:x1869977655196544:12345-192.168.204.36@tcp:101:chown.0 Request processed in 720us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349793.463703:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:1.0:1783349793.466413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.466917:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655196672 00000100:00100000:2.0:1783349793.466942:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655196672 00000100:00100000:2.0:1783349793.467019:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:2.0:1783349793.467031:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:9653:x1869977655196672:12345-192.168.204.36@tcp:101:chown.0 00010000:00010000:2.0:1783349793.467055:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349793.467081:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b958 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467162:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467178:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467190:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467206:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467213:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467219:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467403:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847638b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467412:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847638b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467419:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847638b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349793.467474:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783349793.467478:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349793.467507:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847638b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467520:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467527:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467534:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467540:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349793.467545:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467553:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467567:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320cf8b3100) 00010000:00010000:2.0:1783349793.467570:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349793.467576:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467583:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a4847637d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467599:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467615:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467621:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467626:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349793.467629:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467635:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467643:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9320c3886a00) 00010000:00010000:2.0:1783349793.467645:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349793.467648:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467654:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476384 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467689:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b958 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467703:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847638b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b958 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.467710:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320c3886300) 00010000:00010000:2.0:1783349793.467712:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349793.467720:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96400, rc 0) 00000100:00100000:2.0:1783349793.467910:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:9653:x1869977655196672:12345-192.168.204.36@tcp:101:chown.0 Request processed in 872us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.467919:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:0.0:1783349793.470648:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.470855:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655196928 00000100:00100000:2.0:1783349793.470871:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655196928 00000100:00100000:2.0:1783349793.470952:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:2.0:1783349793.470963:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:9653:x1869977655196928:12345-192.168.204.36@tcp:36:chown.0 00010000:00010000:2.0:1783349793.471042:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349793.471078:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847638b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b958 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.471103:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320c3886300) 00010000:00010000:2.0:1783349793.471117:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349793.471153:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.471169:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.471180:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349793.530360:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000004:00010000:2.0:1783349793.530384:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008bd73b62 reply state 0000000047ae5151 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349793.530402:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783349793.530409:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00200000:2.0:1783349793.530638:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1783349793.530746:0:5784:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783349793.530778:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9653:x1869977655196928:12345-192.168.204.36@tcp:36:chown.0 Request processed in 59802us (60131us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783349793.530843:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00010000:00010000:3.0:1783349793.530931:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.530957:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.530966:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.530973:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.530980:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.530989:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.531020:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349793.531024:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349793.531030:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.531038:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349793.551204:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349793.551595:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655197056 00000100:00100000:1.0:1783349793.551609:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655197056 00000100:00100000:1.0:1783349793.551687:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:1.0:1783349793.551699:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:9654:x1869977655197056:12345-192.168.204.36@tcp:101:touch.500 00010000:00010000:1.0:1783349793.551735:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349793.551762:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b95f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349793.556320:0:6605:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4428us 00010000:00010000:1.0:1783349793.562942:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.562973:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.562987:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563004:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563012:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563018:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563559:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484763ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563570:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484763ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563588:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484763ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349793.563673:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783349793.563678:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349793.563785:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484763ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563832:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563840:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563849:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563857:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349793.563862:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563871:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563887:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320cf8b3100) 00010000:00010000:1.0:1783349793.563891:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349793.563896:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563915:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484763a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563938:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563944:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563951:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563956:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349793.563959:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563966:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563975:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9320e0103700) 00010000:00010000:1.0:1783349793.563978:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349793.563981:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.563987:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484763a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.564038:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b95f expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.564060:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484763ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b95f expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349793.564082:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:1.0:1783349793.564085:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783349793.564088:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacbe00, rc 0) 00000100:00100000:1.0:1783349793.564186:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9654:x1869977655197056:12345-192.168.204.36@tcp:101:touch.500 Request processed in 12487us (12996us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349793.564196:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1783349793.568367:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349793.568480:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655197312 00000100:00100000:3.0:1783349793.568494:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655197312 00000100:00100000:3.0:1783349793.568586:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:3.0:1783349793.568595:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9654:x1869977655197312:12345-192.168.204.36@tcp:101:touch.500 00010000:00010000:3.0:1783349793.568619:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349793.568643:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484763b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b966 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.569172:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.569199:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.569213:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.569232:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.569240:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.569247:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349793.570287:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783349793.570619:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484763ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570637:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484763ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570649:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484763ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570693:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570701:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570709:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570723:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.570729:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570737:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570754:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:3.0:1783349793.570757:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349793.570763:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570769:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484763bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349793.570787:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f0f6573 reply state 000000000ad1133e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349793.570840:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783349793.570889:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484763b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b966 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570917:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484763ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b966 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.570925:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:3.0:1783349793.570927:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349793.570929:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002000, rc 0) 00000100:00100000:3.0:1783349793.571023:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:9654:x1869977655197312:12345-192.168.204.36@tcp:101:touch.500 Request processed in 2428us (2670us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783349793.571042:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00010000:00010000:3.0:1783349793.574999:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.575022:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.575030:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.575037:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.575043:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.575051:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.575073:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x22bab6ae (ffff9320cf8b3d00) 00010000:00010000:3.0:1783349793.575077:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349793.575083:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.575089:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484763c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349793.583287:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.583438:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655197568 00000100:00100000:2.0:1783349793.583451:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655197568 00000100:00100000:2.0:1783349793.583538:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:2.0:1783349793.583550:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:9654:x1869977655197568:12345-192.168.204.36@tcp:36:touch.500 00010000:00010000:2.0:1783349793.583634:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349793.583679:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484763ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b966 expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.583709:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349793.583722:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349793.583784:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.583896:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.583920:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349793.584119:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033e14e64 reply state 000000000a53044b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349793.584130:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349793.584415:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:9654:x1869977655197568:12345-192.168.204.36@tcp:36:touch.500 Request processed in 864us (1146us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783349793.584424:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:1.0:1783349793.594151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.594262:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655197696 00000100:00100000:2.0:1783349793.594275:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655197696 00000100:00100000:2.0:1783349793.594339:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:2.0:1783349793.594347:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:9654:x1869977655197696:12345-192.168.204.36@tcp:101:touch.500 00010000:00010000:2.0:1783349793.594380:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349793.594404:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484763df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b96d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.594488:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484763df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b96d expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.594505:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484763df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b96d expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.594527:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320c3886300) 00010000:00010000:2.0:1783349793.594531:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349793.594535:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96e00, rc 0) 00000100:00100000:2.0:1783349793.594609:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:9654:x1869977655197696:12345-192.168.204.36@tcp:101:touch.500 Request processed in 262us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.594616:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00010000:00010000:3.0:1783349793.595026:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.595036:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.595066:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.595072:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.595077:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.595085:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.595098:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320c3886300) 00010000:00010000:3.0:1783349793.595101:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349793.595104:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.595111:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484763d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349793.602207:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.602486:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655197824 00000100:00100000:2.0:1783349793.602506:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655197824 00000100:00100000:2.0:1783349793.602613:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349793.602623:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1869977655197824:12345-192.168.204.36@tcp:8:touch.500 00010000:00080000:2.0:1783349793.602685:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1783349793.602739:0:6578:0:(genops.c:1406:class_connect()) connect: client ed421ea5-67f7-4096-abd5-85a5a23dfd60, cookie 0x68b4a22a484763e6 00002000:00100000:2.0:1783349793.602757:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed421ea5-67f7-4096-abd5-85a5a23dfd60/ffff9320d1559000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783349793.602833:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783349793.603008:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783349793.603059:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9320d155e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349793.603174:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2358:x1869977655197824:12345-192.168.204.36@tcp:8:touch.500 Request processed in 551us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.603183:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:1.0:1783349793.607479:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.607777:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655197952 00000100:00100000:2.0:1783349793.607825:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655197952 00000100:00100000:2.0:1783349793.607932:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:2.0:1783349793.607944:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f71b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:0:x1869977655197952:12345-192.168.204.36@tcp:2:touch.500 00000100:00080000:0.0:1783349793.608536:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1783349793.650172:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48a60ae5-4060-4be4-9464-772b1677edda 00000020:00000080:2.0:1783349793.650187:0:6607:0:(genops.c:906:class_export_put()) final put ffff9320c86b4800/48a60ae5-4060-4be4-9464-772b1677edda 00000001:00080000:2.0:1783349793.650224:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1783349793.650232:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:2.0:1783349793.650253:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c86b4800/48a60ae5-4060-4be4-9464-772b1677edda for lustre-OST0000 00000020:00000080:2.0:1783349793.650325:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c86b7000 for lustre-OST0000 00000100:00100000:3.0:1783349793.650852:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f71b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:0:x1869977655197952:12345-192.168.204.36@tcp:2:touch.500 Request processed in 42903us (43384us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783349793.650865:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:0.0:1783349793.655139:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349793.655205:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655198208 00000100:00100000:0.0:1783349793.655219:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655198208 00000100:00100000:0.0:1783349793.655293:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:0.0:1783349793.655307:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:9654:x1869977655198208:12345-192.168.204.36@tcp:35:touch.500 00000100:00100000:0.0:1783349793.655772:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:9654:x1869977655198208:12345-192.168.204.36@tcp:35:touch.500 Request processed in 466us (653us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783349793.655781:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00000001:00100000:3.0:1783349793.669974:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48a60ae5-4060-4be4-9464-772b1677edda 00000020:00000080:3.0:1783349793.669988:0:7491:0:(genops.c:906:class_export_put()) final put ffff9320d155a000/48a60ae5-4060-4be4-9464-772b1677edda 00000020:00000080:1.0:1783349793.670071:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320d155a000/48a60ae5-4060-4be4-9464-772b1677edda for lustre-OST0001 00000020:00000080:1.0:1783349793.670139:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320d155d800 for lustre-OST0001 00000100:00100000:1.0:1783349793.670476:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.670571:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655198336 00000100:00100000:2.0:1783349793.670584:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655198336 00000100:00100000:2.0:1783349793.670685:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:2.0:1783349793.670697:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:9655:x1869977655198336:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1783349793.670727:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349793.670754:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484763ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b974 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.670965:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484763f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.671006:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484763f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.671021:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484763f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349793.671101:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783349793.671106:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349793.671155:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484763f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.671191:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484763ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b974 expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.671212:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484763f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b974 expref: 12 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.671222:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:2.0:1783349793.671225:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349793.671230:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97c00, rc 0) 00000100:00100000:2.0:1783349793.671358:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:9655:x1869977655198336:12345-192.168.204.36@tcp:101:rm.0 Request processed in 662us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.671367:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349793.675585:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.675726:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655198592 00000100:00100000:2.0:1783349793.675741:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655198592 00000100:00100000:2.0:1783349793.676077:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:2.0:1783349793.676090:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:9655:x1869977655198592:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1783349793.676120:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349793.676168:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484763fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b97b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349793.676340:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783349793.676581:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484763fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b97b expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.676600:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320cf8b3100) 00010000:00010000:2.0:1783349793.676604:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349793.676610:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484763fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b97b expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.676623:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97a00, rc 0) 00000100:00100000:2.0:1783349793.676932:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:9655:x1869977655198592:12345-192.168.204.36@tcp:101:rm.0 Request processed in 843us (1358us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1783349793.676940:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:0.0:1783349793.682995:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349793.683141:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655198720 00000100:00100000:1.0:1783349793.683156:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655198720 00000100:00100000:1.0:1783349793.683225:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:1.0:1783349793.683239:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:9655:x1869977655198720:12345-192.168.204.36@tcp:37:rm.0 00000100:00100000:2.0:1783349793.694305:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:9655:x1869977655198720:12345-192.168.204.36@tcp:37:rm.0 Request processed in 11051us (11314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.694324:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:0.0:1783349793.698089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.698218:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655198976 00000100:00100000:2.0:1783349793.698233:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655198976 00000100:00100000:2.0:1783349793.698342:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:2.0:1783349793.698354:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:9655:x1869977655198976:12345-192.168.204.36@tcp:35:rm.0 00000100:00100000:2.0:1783349793.698748:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:9655:x1869977655198976:12345-192.168.204.36@tcp:35:rm.0 Request processed in 395us (678us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783349793.698758:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:0.0:1783349793.702043:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349793.702228:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655199232 00000100:00100000:3.0:1783349793.702243:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655199232 00000100:00100000:3.0:1783349793.702344:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:3.0:1783349793.702358:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:9655:x1869977655199232:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:3.0:1783349793.702399:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349793.702766:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b982 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.703237:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476410 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.703257:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476410 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.703271:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476410 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349793.703284:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783349793.703584:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b982 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.703607:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476410 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b982 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.703616:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:3.0:1783349793.703619:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783349793.703623:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002c00, rc 0) 00000100:00100000:3.0:1783349793.703783:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655199232:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1426us (1754us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783349793.703851:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:3.0:1783349793.706879:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349793.707048:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655199360 00000100:00100000:0.0:1783349793.707062:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655199360 00000100:00100000:0.0:1783349793.707138:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:0.0:1783349793.707150:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655199360:12345-192.168.204.36@tcp:41:rm.0 00000004:00000024:0.0:1783349793.707229:0:5785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1783349793.707331:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655199360:12345-192.168.204.36@tcp:41:rm.0 Request processed in 183us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349793.707340:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:0.0:1783349793.713645:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.713858:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655199488 00000100:00100000:2.0:1783349793.713909:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655199488 00000100:00100000:2.0:1783349793.714002:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:2.0:1783349793.714015:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655199488:12345-192.168.204.36@tcp:101:rm.0 00010000:00010000:2.0:1783349793.714051:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349793.714084:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847641e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b989 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714183:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714206:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714222:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714243:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714250:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714257:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714507:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714517:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714525:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349793.714575:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783349793.714579:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349793.714602:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714615:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714624:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714631:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714638:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714645:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349793.714649:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714657:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714670:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:2.0:1783349793.714673:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349793.714679:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714685:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714715:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714722:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714727:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714732:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349793.714735:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714741:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714748:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x22bab6ae (ffff9320c3886f00) 00010000:00010000:2.0:1783349793.714749:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349793.714752:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714757:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847642c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714879:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847641e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b989 expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714894:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b989 expref: 17 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.714923:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320c3886300) 00010000:00010000:2.0:1783349793.714925:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349793.714928:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96600, rc 0) 00000100:00100000:2.0:1783349793.715012:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:9655:x1869977655199488:12345-192.168.204.36@tcp:101:rm.0 Request processed in 1000us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349793.715020:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:1.0:1783349793.721524:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349793.721754:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655199744 00000100:00100000:0.0:1783349793.721769:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655199744 00000100:00100000:0.0:1783349793.721864:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:0.0:1783349793.721875:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:9655:x1869977655199744:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:0.0:1783349793.721964:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783349793.722000:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b989 expref: 17 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722044:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484763df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b96d expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722057:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320c3886300) 00010000:00010000:0.0:1783349793.722078:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484763f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b974 expref: 15 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722087:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:0.0:1783349793.722091:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349793.722116:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722132:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722143:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722160:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722168:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722174:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722733:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722749:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.722755:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349793.724726:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783349793.724740:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180786946874ns, next at 181786943894ns, rc = 0 00010000:00010000:0.0:1783349793.724853:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724870:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724881:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724892:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724910:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724917:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724952:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349793.724984:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.724992:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725009:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725016:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175ae00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349793.725021:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725029:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725043:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320c2913c00) 00010000:00010000:0.0:1783349793.725047:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783349793.725053:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725059:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ae00/0x68b4a22a48476448 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725083:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725089:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725095:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725100:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175ac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349793.725103:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725120:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725130:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:0.0:1783349793.725132:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349793.725136:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349793.725141:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847643a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349793.725153:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000525b117 reply state 0000000078da48e9 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349793.725163:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349793.725470:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655199744:12345-192.168.204.36@tcp:36:rm.0 Request processed in 3590us (3954us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783349793.725483:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 29 00010000:00010000:2.0:1783349793.725505:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349793.725515:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.725525:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175b200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349793.725529:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.725536:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.725548:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9320c2913c00) 00010000:00010000:2.0:1783349793.725551:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783349793.725555:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.725562:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b200/0x68b4a22a4847644f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.725582:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349793.725584:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349793.725587:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349793.727503:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.727586:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.727611:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.727617:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175bc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.727622:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.727630:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.727649:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x22bab6ae (ffff9320c2913200) 00010000:00010000:3.0:1783349793.727653:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349793.727657:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.727663:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476441 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349793.728765:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.728868:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200000 00000100:00100000:2.0:1783349793.728906:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200000 00000100:00100000:2.0:1783349793.728985:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:2.0:1783349793.728998:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:9655:x1869977655200000:12345-192.168.204.36@tcp:35:rm.0 00000100:00100000:2.0:1783349793.729353:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655200000:12345-192.168.204.36@tcp:35:rm.0 Request processed in 357us (599us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783349793.729363:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:0.0:1783349793.740220:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349793.740333:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200256 00000100:00100000:2.0:1783349793.740351:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200256 00000100:00100000:2.0:1783349793.740438:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1783349793.740450:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:9655:x1869977655200256:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:2.0:1783349793.740549:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783349793.740588:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476410 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b982 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740618:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484763ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b95f expref: 15 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740631:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320e0103600) 00010000:00010000:2.0:1783349793.740652:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a4847636f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b951 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740661:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320cf8b3100) 00010000:00010000:2.0:1783349793.740669:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349793.740703:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740719:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740752:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740769:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740777:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.740785:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.741336:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.741347:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.741356:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349793.742216:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783349793.742243:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742253:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742260:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742267:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349793.742283:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742292:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742308:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349793.742312:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783349793.742316:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742323:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476464 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742350:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742356:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742362:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742367:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349793.742369:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742374:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742381:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349793.742384:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349793.742393:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349793.742399:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476456 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349793.742410:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000298e684e reply state 00000000c96e2fd6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349793.742420:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349793.742547:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:9655:x1869977655200256:12345-192.168.204.36@tcp:36:rm.0 Request processed in 2095us (2340us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783349793.742558:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 30 00010000:00010000:3.0:1783349793.744720:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.744742:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.744750:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.744757:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349793.744762:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.744853:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.744876:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9320c3886a00) 00010000:00010000:3.0:1783349793.744879:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349793.744884:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349793.744890:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847645d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349794.474237:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349794.666203:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666759680:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.666208:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666759552:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.666306:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349794.666323:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349794.666370:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783349794.666380:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666759424:0@lo:400:kworker.0 00000100:00100000:1.0:1783349794.666386:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783349794.666400:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666759296:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.666412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349794.666441:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666759936:0@lo:400:kworker.0 00000100:00100000:1.0:1783349794.666457:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349794.666477:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349794.666510:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666759808:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.666529:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759552 00000100:00100000:2.0:1783349794.666538:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759552 00000100:00100000:1.0:1783349794.666568:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349794.666604:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759424 00000100:00100000:2.0:1783349794.666608:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759424 00000100:00100000:2.0:1783349794.666636:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759808 00000100:00100000:1.0:1783349794.666637:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759680 00000100:00100000:2.0:1783349794.666641:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759808 00000100:00100000:1.0:1783349794.666646:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759680 00000100:00100000:2.0:1783349794.666662:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783349794.666676:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666759552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349794.666703:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759936 00000100:00100000:1.0:1783349794.666709:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759936 00000100:00100000:2.0:1783349794.666740:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666759552:12345-0@lo:400:kworker.0 Request processed in 69us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.666756:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783349794.666773:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783349794.666778:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666759424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.666826:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666759424:12345-0@lo:400:kworker.0 Request processed in 47us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.666831:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783349794.666840:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783349794.666846:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666759808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667033:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666759808:12345-0@lo:400:kworker.0 Request processed in 186us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.667040:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783349794.667062:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349794.667070:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666759680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667101:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666759680:12345-0@lo:400:kworker.0 Request processed in 34us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.667107:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349794.667120:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349794.667126:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666759936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667152:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666759936:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.667157:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349794.667195:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666759424:0@lo:400:kworker.0 00010000:00080000:2.0:1783349794.667208:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb4d1880 x1869977666759936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349794.667230:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666759936:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667243:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666759552:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667302:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666759296 00000100:00100000:2.0:1783349794.667307:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666759296 00000100:00100000:2.0:1783349794.667334:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783349794.667341:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666759296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667371:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666759296:12345-0@lo:400:kworker.0 Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349794.667377:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:2.0:1783349794.667411:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349794.667416:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349794.667440:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666759296:0@lo:400:kworker.0 00000100:00100000:2.0:1783349794.667451:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666759808:0@lo:400:kworker.0 00010000:00080000:2.0:1783349794.667461:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb4d0000 x1869977666759680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349794.667470:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666759680:0@lo:400:kworker.0 00000100:00100000:2.0:1783349795.180623:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666760064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349795.180696:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349795.180913:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760064 00000100:00100000:0.0:1783349795.180923:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760064 00000100:00100000:0.0:1783349795.181023:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349795.181034:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666760064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349795.181070:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349795.181117:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666760064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349795.181125:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1783349795.181243:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c0700 x1869977666760064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349795.181261:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666760064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349795.501955:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349796.524435:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349796.764681:0:11449:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1783349797.546280:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783349797.585653:0:11497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc97d24a70 20000000:00000080:0.0:1783349797.585679:0:11497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9320fb4c4c00 uarg=0000000000000000 20000000:01000000:0.0:1783349797.585719:0:11497:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783349797.585727:0:11497:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783349797.585733:0:11497:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783349797.587168:0:11498:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1783349797.587352:0:11497:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1783349797.593158:0:11497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1783349797.593889:0:11497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1783349797.593965:0:11497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1783349797.593985:0:11497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783349797.594005:0:11497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594026:0:11497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594034:0:11497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594042:0:11497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847631b expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594049:0:11497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476329 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594057:0:11497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476337 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594066:0:11497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594108:0:11497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476337 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594135:0:11497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476337 expref: 18 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.594153:0:11497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760192:0@lo:104: 00000100:00100000:0.0:1783349797.594229:0:11497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349797.594390:0:11497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48476329 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594399:0:11497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48476329 expref: 18 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.594408:0:11497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760320:0@lo:104: 00000100:00100000:0.0:1783349797.594430:0:11497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349797.594635:0:11497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a4847631b expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.594645:0:11497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a4847631b expref: 18 pid: 5777 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.594655:0:11497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760448:0@lo:104: 00000100:00100000:0.0:1783349797.594679:0:11497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.594820:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760192 00000100:00100000:2.0:1783349797.594847:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760192 00000100:00100000:2.0:1783349797.594895:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760320 00000100:00100000:2.0:1783349797.594898:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760320 00000100:00100000:2.0:1783349797.594915:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349797.594925:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:11497:x1869977666760192:12345-0@lo:104: 00010000:00010000:2.0:1783349797.594941:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.594999:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349797.595006:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+4:11497:x1869977666760192:12345-0@lo:104: Request processed in 84us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.595013:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349797.595032:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349797.595038:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:11497:x1869977666760320:12345-0@lo:104: 00010000:00010000:2.0:1783349797.595045:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595077:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783349797.595082:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:11497:x1869977666760320:12345-0@lo:104: Request processed in 45us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.595088:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1783349797.595107:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349797.595114:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595123:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349797.595128:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595151:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.595161:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.595169:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.595208:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595216:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.595243:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595251:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9003400/0x68b4a22a48476337 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847633e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595342:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349797.595346:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595352:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175aa00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349797.595356:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595364:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.595369:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.595380:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.595396:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595401:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.595408:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595414:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d175aa00/0x68b4a22a48476329 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476330 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.595423:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.595424:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.595425:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.595434:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349797.595451:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666760576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349797.595485:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.595683:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349797.595689:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666760704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349797.595710:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.595952:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760576 00000100:00100000:2.0:1783349797.595958:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760576 00010000:00010000:2.0:1783349797.595977:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476337 expref: 19 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.595997:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760704 00000100:00100000:2.0:1783349797.595999:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760704 00010000:00010000:2.0:1783349797.596007:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476329 expref: 20 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.596030:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349797.596036:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:3291:x1869977666760576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349797.596050:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349797.596057:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476337 expref: 20 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596067:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476337 expref: 20 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596089:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349797.596121:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:3291:x1869977666760576:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.596128:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349797.596145:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349797.596151:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666760704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349797.596157:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349797.596162:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48476329 expref: 19 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596171:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48476329 expref: 19 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596180:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349797.596198:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666760704:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.596204:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783349797.596238:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666760704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349797.596252:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666760576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349797.596391:0:11497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.596405:0:11497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 12 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.596416:0:11497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760832:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349797.596811:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783349797.596831:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760448 00000100:00100000:2.0:1783349797.596835:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760448 00000100:00100000:2.0:1783349797.596857:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349797.596862:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:11497:x1869977666760448:12345-0@lo:104: 00010000:00010000:2.0:1783349797.596875:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596910:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783349797.596915:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+3:11497:x1869977666760448:12345-0@lo:104: Request processed in 53us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.596921:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1783349797.596962:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349797.596967:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596976:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002200 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349797.596980:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.596988:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349797.596996:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349797.597002:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783349797.597027:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.597035:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349797.597053:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.597060:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9002200/0x68b4a22a4847631b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48476322 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.597077:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.597079:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349797.597080:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349797.597109:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fade8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666760960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349797.597136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349797.597163:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666760960 00000100:00100000:2.0:1783349797.597167:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666760960 00010000:00010000:2.0:1783349797.597181:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847631b expref: 19 pid: 5777 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.597199:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783349797.597204:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666760960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349797.597213:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349797.597217:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847631b expref: 19 pid: 5777 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.597226:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a4847631b expref: 19 pid: 5777 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.597237:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349797.597441:0:11497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349797.597452:0:11497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.597461:0:11497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666761088:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349797.597496:0:11497:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c744e900 going to sleep for 11 seconds 00010000:00010000:0.0:1783349797.597511:0:11497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9002400/0x68b4a22a4847633e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476337 expref: 19 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.597521:0:11497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760192:0@lo:104: 00010000:00010000:0.0:1783349797.597530:0:11497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faacb000/0x68b4a22a48476330 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48476329 expref: 18 pid: 5778 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.597538:0:11497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760320:0@lo:104: 00010000:00010000:0.0:1783349797.597544:0:11497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175a000/0x68b4a22a48476322 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a4847631b expref: 17 pid: 5777 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349797.597618:0:11497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760448:0@lo:104: 00000100:00100000:2.0:1783349797.598013:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3293:x1869977666760960:12345-0@lo:103:ldlm_bl.0 Request processed in 807us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.598021:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783349797.598241:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fade8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666760960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349797.602780:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349797.602847:0:11497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666760832:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349797.602919:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200384 00000100:00100000:2.0:1783349797.602928:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200384 00010000:00010000:2.0:1783349797.602966:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 13 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349797.603004:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:2.0:1783349797.603014:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655200384:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349797.603031:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349797.603038:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 13 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.603049:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 13 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.603068:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac97e00/0x68b4a22a48476314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b943 expref: 13 pid: 5778 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.603082:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349797.603138:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:2361:x1869977655200384:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 125us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349797.603147:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:2.0:1783349797.606585:0:11497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11497:1869977666761088:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349797.606624:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:2.0:1783349797.606633:0:11497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349797.606733:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200512 00000100:00100000:1.0:1783349797.606741:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200512 00010000:00010000:1.0:1783349797.606887:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349797.606925:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:1.0:1783349797.606938:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:2362:x1869977655200512:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349797.606954:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349797.606961:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.606973:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.606992:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faaca800/0x68b4a22a4847630d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b93c expref: 12 pid: 5779 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607008:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607044:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607064:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607073:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607081:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607088:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607095:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175b200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349797.607099:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.607107:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.607280:0:11497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349797.607296:0:11497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.608038:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.608054:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175b200/0x68b4a22a4847646b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349797.608080:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349797.608168:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:2362:x1869977655200512:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 1230us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349797.608252:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00000004:00080000:1.0:1783349798.250284:0:7169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185312489062ns, next at 186312487057ns, rc = 0 00000100:00100000:2.0:1783349798.250295:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349798.250318:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666761216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349798.250383:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349798.250847:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761216 00000100:00100000:3.0:1783349798.250856:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761216 00000100:00100000:3.0:1783349798.250925:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349798.250934:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666761216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349798.250968:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349798.251031:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666761216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.251038:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1783349798.251093:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb4d2300 x1869977666761216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349798.251115:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666761216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783349798.251216:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349798.496003:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349798.496045:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349798.496075:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349798.496108:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200768 00000100:00100000:0.0:1783349798.496114:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349798.496120:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200768 00000100:00100000:0.0:1783349798.496157:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200896 00000100:00100000:0.0:1783349798.496161:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200896 00000100:00100000:1.0:1783349798.496186:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201024 00000100:00100000:1.0:1783349798.496191:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201024 00000100:00100000:1.0:1783349798.496214:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:1.0:1783349798.496224:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:2360:x1869977655200768:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349798.496242:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655200640 00000100:00100000:3.0:1783349798.496247:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655200640 00000100:00100000:3.0:1783349798.496280:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:3.0:1783349798.496289:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:2360:x1869977655200640:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349798.496314:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:2360:x1869977655200768:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 89us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349798.496322:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:2360:x1869977655200640:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349798.496326:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:3.0:1783349798.496341:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:1.0:1783349798.496348:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:1.0:1783349798.496357:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655201024:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349798.496398:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655201024:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.496405:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:1.0:1783349798.496407:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:0.0:1783349798.496416:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655200896:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349798.496442:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655200896:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349798.496448:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00080000:0.0:1783349798.496679:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783349798.496684:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783349798.570488:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783349798.807317:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1783349798.807327:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1783349798.807478:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1783349798.807692:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666761344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783349798.807762:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1783349798.808119:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1783349798.808304:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761344 00000100:00100000:1.0:1783349798.808312:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761344 00000100:00100000:1.0:1783349798.808360:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349798.808384:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666761344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783349798.808415:0:6579:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1783349798.808449:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4bc220, atime: 0x6a4bc220, ctime: 0x6a4bc220, blocks: 0x1 00010000:00010000:1.0:1783349798.808457:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.808474:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=185s v=(0 0) 00010000:00010000:1.0:1783349798.808478:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349798.808485:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.808500:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.808510:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.808517:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349798.808537:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349798.809029:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349798.809037:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.809046:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349798.809050:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.809060:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.809080:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.809087:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476472 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349798.809106:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349798.809115:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349798.809116:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349798.809633:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1869977666761344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1248us (1868us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783349798.809642:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1783349798.809712:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320f70c2d80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1783349798.809719:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666761344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783349799.323921:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349799.324092:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201152 00000100:00100000:2.0:1783349799.324103:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201152 00000100:00100000:2.0:1783349799.324166:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:2.0:1783349799.324176:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:5568:x1869977655201152:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349799.324194:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349799.324215:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac96c00/0x68b4a22a48476479 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b990 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349799.324245:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96c00/0x68b4a22a48476479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b990 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349799.324257:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac96c00/0x68b4a22a48476479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b990 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349799.324354:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96c00, rc 0) 00000100:00100000:2.0:1783349799.324422:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655201152:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 244us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.324431:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:0.0:1783349799.327959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349799.329138:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201280 00000100:00100000:3.0:1783349799.329152:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201280 00000100:00100000:3.0:1783349799.329217:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:3.0:1783349799.329227:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655201280:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349799.329901:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655201280:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 670us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.329911:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:0.0:1783349799.337784:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349799.337972:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201408 00000100:00100000:2.0:1783349799.337984:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201408 00000100:00100000:2.0:1783349799.338058:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:2.0:1783349799.338069:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655201408:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349799.338368:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655201408:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 300us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.338377:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:1.0:1783349799.341567:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349799.341896:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201536 00000100:00100000:0.0:1783349799.341911:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201536 00000100:00100000:0.0:1783349799.341969:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:0.0:1783349799.341981:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:9925:x1869977655201536:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349799.342267:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:9925:x1869977655201536:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 288us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.342276:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:0.0:1783349799.349726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349799.349941:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201664 00000100:00100000:2.0:1783349799.349954:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201664 00000100:00100000:2.0:1783349799.350015:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:2.0:1783349799.350025:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:9925:x1869977655201664:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783349799.350277:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:9925:x1869977655201664:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 252us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.350285:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:2.0:1783349799.356115:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349799.357847:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201792 00000100:00100000:0.0:1783349799.357862:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201792 00000100:00100000:0.0:1783349799.357989:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:0.0:1783349799.358000:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:5568:x1869977655201792:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349799.358019:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349799.358039:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175b800/0x68b4a22a48476480 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b997 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.358070:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175b800/0x68b4a22a48476480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b997 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.358082:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175b800/0x68b4a22a48476480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b997 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.358093:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175b800, rc 0) 00000100:00100000:0.0:1783349799.358181:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655201792:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 183us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.358189:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:1.0:1783349799.368411:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349799.369232:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655201920 00000100:00100000:3.0:1783349799.369242:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655201920 00000100:00100000:3.0:1783349799.369303:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:3.0:1783349799.369314:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655201920:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349799.369622:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655201920:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 308us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.369630:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:1.0:1783349799.374468:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349799.374581:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202048 00000100:00100000:0.0:1783349799.374592:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202048 00000100:00100000:0.0:1783349799.374651:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:0.0:1783349799.374661:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655202048:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.375203:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:5568:x1869977655202048:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 541us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.375212:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:0.0:1783349799.377505:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349799.377599:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202176 00000100:00100000:2.0:1783349799.377611:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202176 00000100:00100000:2.0:1783349799.377661:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:2.0:1783349799.377671:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:9928:x1869977655202176:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783349799.378026:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:9928:x1869977655202176:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 355us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.378043:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:1.0:1783349799.380945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349799.381046:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202304 00000100:00100000:0.0:1783349799.381055:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202304 00000100:00100000:0.0:1783349799.381111:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 240 00000100:00100000:0.0:1783349799.381120:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:9928:x1869977655202304:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349799.381491:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:9928:x1869977655202304:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 370us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.381499:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 240 10000000:01000000:2.0:1783349799.531844:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783349799.531855:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c970f800 from 7 10000000:01000000:2.0:1783349799.531862:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349799.531927:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349799.531939:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349799.531949:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349799.531977:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fadead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666761472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783349799.532057:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349799.532125:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c4a14c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349799.532253:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761472 00000100:00100000:3.0:1783349799.532261:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761472 00000100:00100000:3.0:1783349799.532358:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1783349799.532367:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:5781:x1869977666761472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349799.532382:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349799.532395:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9002e00/0x68b4a22a4847648e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476487 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349799.532416:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002e00/0x68b4a22a4847648e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476487 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349799.532442:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9002e00/0x68b4a22a4847648e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476487 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349799.532451:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002e00, rc 0) 00000100:00100000:3.0:1783349799.532502:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666761472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.532509:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783349799.532583:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fadead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666761472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349799.532597:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.532606:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349799.532668:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666761600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.532704:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.534183:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c744e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349799.534275:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761600 00000100:00100000:2.0:1783349799.534283:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761600 00000100:00100000:2.0:1783349799.534324:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783349799.534333:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666761600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349799.534657:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666761600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.534666:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783349799.536035:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666761600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.536096:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666761728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.536160:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.536259:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c744e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349799.536301:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761728 00000100:00100000:2.0:1783349799.536308:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761728 00000100:00100000:2.0:1783349799.536405:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783349799.536415:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666761728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349799.536612:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666761728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.536626:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783349799.536699:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666761728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.537408:0:11513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11513:1869977666761856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.537450:0:11513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.537592:0:11513:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3000 going to sleep for 11 seconds 00000100:00100000:3.0:1783349799.537673:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761856 00000100:00100000:3.0:1783349799.537679:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761856 00000100:00100000:3.0:1783349799.537705:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783349799.537712:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:11513:x1869977666761856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349799.537918:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:11513:x1869977666761856:12345-0@lo:502:llog_process_th.0 Request processed in 205us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.537924:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783349799.538013:0:11513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11513:1869977666761856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349799.538035:0:11513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349799.538044:0:11513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349799.538046:0:11513:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349799.538053:0:11513:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9320c970f800 00000020:00000080:0.0:1783349799.538056:0:11513:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349799.538180:0:11513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11513:1869977666761984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.538216:0:11513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.538237:0:11513:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.539726:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666761984 00000100:00100000:0.0:1783349799.539735:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666761984 00000100:00100000:0.0:1783349799.539776:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783349799.539833:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:11513:x1869977666761984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.540081:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:11513:x1869977666761984:12345-0@lo:502:llog_process_th.0 Request processed in 296us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.540099:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783349799.540154:0:11513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11513:1869977666761984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349799.540180:0:11513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349799.540187:0:11513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349799.540189:0:11513:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783349799.540193:0:11513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783349799.540303:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783349799.540323:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349799.540333:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540344:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349799.540353:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349799.540355:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f70f3800 from 7 10000000:01000000:0.0:1783349799.540358:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349799.540386:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540394:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540402:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349799.540422:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.540458:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.540485:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.540503:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762112 00000100:00100000:0.0:1783349799.540507:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762112 00000100:00100000:0.0:1783349799.540525:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783349799.540530:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:5781:x1869977666762112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349799.540539:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349799.540551:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175b200/0x68b4a22a4847649c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48476495 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540573:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175b200/0x68b4a22a4847649c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48476495 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540583:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175b200/0x68b4a22a4847649c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48476495 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540591:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175b200, rc 0) 00000100:00100000:0.0:1783349799.540619:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666762112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.540625:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783349799.540653:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349799.540665:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.540673:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349799.540710:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.540734:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.540746:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.540763:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762240 00000100:00100000:0.0:1783349799.540766:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762240 00000100:00100000:0.0:1783349799.540782:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783349799.540824:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666762240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.541032:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666762240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.541039:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783349799.541068:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.541094:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.541129:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.541142:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.541153:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762368 00000100:00100000:0.0:1783349799.541156:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762368 00000100:00100000:0.0:1783349799.541171:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783349799.541177:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666762368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.541298:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666762368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.541305:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783349799.541339:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.541515:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11514:1869977666762496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.541547:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.541565:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762496 00000100:00100000:0.0:1783349799.541570:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762496 00000100:00100000:0.0:1783349799.541585:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783349799.541591:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:11514:x1869977666762496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.541703:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:11514:x1869977666762496:12345-0@lo:502:llog_process_th.0 Request processed in 112us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.541710:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783349799.541736:0:11514:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.541747:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11514:1869977666762496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349799.541763:0:11514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349799.541770:0:11514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349799.541772:0:11514:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349799.541778:0:11514:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9320f70f3800 00000020:00000080:0.0:1783349799.541780:0:11514:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349799.541874:0:11514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11514:1869977666762624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.541906:0:11514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.541924:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762624 00000100:00100000:0.0:1783349799.541927:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762624 00000100:00100000:0.0:1783349799.541943:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783349799.541948:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:11514:x1869977666762624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.542052:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:11514:x1869977666762624:12345-0@lo:502:llog_process_th.0 Request processed in 103us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.542058:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783349799.542085:0:11514:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.542096:0:11514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11514:1869977666762624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349799.542114:0:11514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349799.542119:0:11514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349799.542120:0:11514:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783349799.542124:0:11514:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783349799.542165:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783349799.542189:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349799.542196:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542206:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349799.542215:0:5781:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349799.542217:0:5781:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320c6fcb000 from 7 10000000:01000000:0.0:1783349799.542219:0:5781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349799.542237:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542244:0:5781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542252:0:5781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349799.542264:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.542290:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.542303:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.542314:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762752 00000100:00100000:0.0:1783349799.542317:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762752 00000100:00100000:0.0:1783349799.542334:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783349799.542340:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:5781:x1869977666762752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349799.542348:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349799.542358:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320d175ae00/0x68b4a22a484764aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484764a3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542392:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320d175ae00/0x68b4a22a484764aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484764a3 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542400:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320d175ae00/0x68b4a22a484764aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484764a3 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542408:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175ae00, rc 0) 00000100:00100000:0.0:1783349799.542436:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666762752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.542442:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783349799.542470:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349799.542481:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349799.542489:0:5781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349799.542524:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.542547:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.542559:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1783349799.542569:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666762880 00000100:00100000:0.0:1783349799.542572:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666762880 00000100:00100000:0.0:1783349799.542587:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783349799.542593:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666762880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349799.542784:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:5781:x1869977666762880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.545039:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666762880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783349799.545110:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666763008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349799.545176:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349799.545204:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349799.545226:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763008 00000100:00100000:3.0:1783349799.545232:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763008 00000100:00100000:3.0:1783349799.545270:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783349799.545278:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:5781:x1869977666763008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349799.545467:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:5781:x1869977666763008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.545476:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783349799.545530:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47d1b48f-2d78-45ee-b062-943ed61d9bed:5781:1869977666763008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349799.545744:0:11516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11516:1869977666763136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349799.545778:0:11516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.549172:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783349799.549263:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763136 00000100:00100000:1.0:1783349799.549346:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763136 00000100:00100000:1.0:1783349799.549387:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783349799.549395:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:11516:x1869977666763136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349799.550622:0:11516:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349799.551088:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:11516:x1869977666763136:12345-0@lo:502:llog_process_th.0 Request processed in 1689us (5305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349799.551098:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783349799.551233:0:11516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11516:1869977666763136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349799.551265:0:11516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349799.551274:0:11516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349799.551276:0:11516:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349799.551283:0:11516:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9320c6fcb000 00000020:00000080:0.0:1783349799.551286:0:11516:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783349799.551435:0:11516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11516:1869977666763264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349799.551477:0:11516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.551509:0:11516:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d17b3780 going to sleep for 11 seconds 00000100:00100000:1.0:1783349799.551612:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763264 00000100:00100000:1.0:1783349799.551618:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763264 00000100:00100000:1.0:1783349799.551657:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783349799.551665:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:11516:x1869977666763264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349799.551843:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d106d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:11516:x1869977666763264:12345-0@lo:502:llog_process_th.0 Request processed in 178us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349799.551851:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783349799.551977:0:11516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47d1b48f-2d78-45ee-b062-943ed61d9bed:11516:1869977666763264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349799.551996:0:11516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349799.552000:0:11516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349799.552001:0:11516:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783349799.552005:0:11516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783349799.552227:0:5781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783349799.552246:0:5781:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349799.552257:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349799.552269:0:5781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349799.554353:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783349799.594043:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349799.786234:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666763648:0@lo:400:kworker.0 00000100:00100000:3.0:1783349799.786331:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349799.786398:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349799.786405:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666763520:0@lo:400:kworker.0 00000100:00100000:3.0:1783349799.786447:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349799.786489:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763648 00000100:00100000:3.0:1783349799.786497:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763648 00000100:00100000:3.0:1783349799.786554:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783349799.786564:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1869977666763648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349799.786625:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1869977666763648:12345-0@lo:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.786634:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783349799.786659:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763520 00000100:00100000:3.0:1783349799.786663:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763520 00000100:00100000:3.0:1783349799.786706:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783349799.786713:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666763520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349799.786745:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666763520:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349799.786752:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1783349799.786773:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349799.786864:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666763520:0@lo:400:kworker.0 00000100:00100000:3.0:1783349799.786878:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666763648:0@lo:400:kworker.0 00000100:00100000:2.0:1783349799.787564:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666763392:0@lo:400:kworker.0 00000100:00100000:2.0:1783349799.787603:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349799.787687:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666763904:0@lo:400:kworker.0 00000100:00100000:2.0:1783349799.787712:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349799.787739:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349799.787746:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666763776:0@lo:400:kworker.0 00000100:00100000:2.0:1783349799.787768:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349799.787843:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763904 00000100:00100000:0.0:1783349799.787850:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763904 00000100:00080000:3.0:1783349799.787890:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349799.787892:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349799.787902:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666763904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349799.787952:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666763904:12345-0@lo:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349799.787959:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1783349799.787960:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb4c8000 x1869977666763904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349799.787971:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666763904:0@lo:400:kworker.0 00000100:00100000:1.0:1783349799.788004:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763392 00000100:00100000:1.0:1783349799.788008:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763392 00000100:00100000:1.0:1783349799.788075:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666763776 00000100:00100000:1.0:1783349799.788079:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666763776 00000100:00080000:0.0:1783349799.788152:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349799.788183:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783349799.788191:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666763392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349799.788235:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666763392:12345-0@lo:400:kworker.0 Request processed in 46us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.788242:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783349799.788255:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783349799.788261:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666763776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349799.788288:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666763776:12345-0@lo:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349799.788294:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349799.788374:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666763776:0@lo:400:kworker.0 00000100:00100000:0.0:1783349799.788385:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666763392:0@lo:400:kworker.0 00000100:00100000:3.0:1783349800.299104:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349800.299126:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666764032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349800.299200:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349800.300267:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764032 00000100:00100000:2.0:1783349800.300278:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764032 00000100:00100000:2.0:1783349800.300974:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349800.300987:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666764032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349800.301031:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349800.301113:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666764032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349800.301120:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783349800.301207:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c0000 x1869977666764032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349800.301227:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666764032:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1783349800.618519:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783349800.618977:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349801.642033:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349802.668342:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349803.370059:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666764160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349803.370196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349803.370748:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764160 00000100:00100000:1.0:1783349803.370756:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764160 00000100:00100000:1.0:1783349803.370841:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783349803.370854:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869977666764160:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783349803.370868:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783349803.370891:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349803.370941:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1869977666764160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349803.370949:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349803.370988:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666764160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349803.612743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349803.612809:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349803.612848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349803.612889:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349803.612913:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202432 00000100:00100000:3.0:1783349803.612922:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202560 00000100:00100000:0.0:1783349803.612924:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202432 00000100:00100000:3.0:1783349803.612930:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202560 00000100:00100000:1.0:1783349803.612936:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202688 00000100:00100000:1.0:1783349803.612941:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202688 00000100:00100000:0.0:1783349803.612976:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:3.0:1783349803.612988:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202816 00000100:00100000:0.0:1783349803.612988:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655202432:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349803.612994:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202816 00000100:00100000:1.0:1783349803.612994:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1783349803.613009:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655202688:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349803.613031:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:3.0:1783349803.613041:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655202560:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349803.613070:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655202432:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349803.613076:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 256 00000100:00100000:0.0:1783349803.613118:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:0.0:1783349803.613123:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655202816:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:2.0:1783349803.613169:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349803.613173:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349803.613741:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655202688:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 734us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349803.613749:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:0.0:1783349803.616124:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655202816:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2987us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349803.616140:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:3.0:1783349803.620169:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655202560:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 7112us (7417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349803.620188:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00010000:00010000:2.0:1783349803.690306:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783349803.916015:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1783349804.714042:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349804.907701:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666764672:0@lo:400:kworker.0 00000100:00100000:0.0:1783349804.907754:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666764416:0@lo:400:kworker.0 00000100:00100000:3.0:1783349804.907778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349804.907781:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349804.907848:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764672 00000100:00100000:1.0:1783349804.907857:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764672 00000100:00100000:2.0:1783349804.907873:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666764288:0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.907908:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349804.907918:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.907969:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666764672:12345-0@lo:400:kworker.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349804.907976:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349804.908033:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666764544:0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.908062:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349804.908124:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764416 00000100:00100000:1.0:1783349804.908128:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764416 00000100:00100000:1.0:1783349804.908150:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764544 00000100:00100000:1.0:1783349804.908154:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764544 00000100:00100000:1.0:1783349804.908179:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349804.908186:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666764416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.908218:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666764416:12345-0@lo:400:kworker.0 Request processed in 32us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349804.908224:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349804.908235:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783349804.908241:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666764544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.908270:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666764544:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349804.908276:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783349804.908314:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666764544:0@lo:400:kworker.0 00000100:00080000:1.0:1783349804.908350:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349804.908615:0:3294:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1783349804.908622:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320f70c2d80, transno 4294967300 00000100:00100000:3.0:1783349804.908638:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666764672:0@lo:400:kworker.0 00000100:00100000:0.0:1783349804.909984:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666764416:0@lo:400:kworker.0 00000100:00100000:0.0:1783349804.909995:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666764928:0@lo:400:kworker.0 00000100:00100000:0.0:1783349804.910038:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349804.910171:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764928 00000100:00100000:3.0:1783349804.910177:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764928 00000100:00100000:3.0:1783349804.910241:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783349804.910249:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349804.910298:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666764928:12345-0@lo:400:kworker.0 Request processed in 50us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349804.910306:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1783349804.910317:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783349804.910394:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb4c9500 x1869977666764928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349804.910406:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666764928:0@lo:400:kworker.0 00000100:00100000:2.0:1783349804.911044:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349804.911362:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764288 00000100:00100000:0.0:1783349804.911381:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764288 00000100:00100000:2.0:1783349804.911407:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666764800:0@lo:400:kworker.0 00000100:00100000:0.0:1783349804.911424:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783349804.911430:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666764288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349804.911469:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666764288:12345-0@lo:400:kworker.0 Request processed in 39us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349804.911475:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783349804.911648:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349804.911698:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666764288:0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.911713:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666764800 00000100:00100000:1.0:1783349804.911719:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666764800 00000100:00080000:2.0:1783349804.911746:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349804.911772:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783349804.911781:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666764800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349804.911860:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666764800:12345-0@lo:400:kworker.0 Request processed in 80us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349804.911867:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783349804.911960:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666764800:0@lo:400:kworker.0 00000100:00100000:1.0:1783349805.418370:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666765056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349805.418472:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349805.418785:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765056 00000100:00100000:2.0:1783349805.418815:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765056 00000100:00100000:2.0:1783349805.418880:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783349805.418891:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666765056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349805.418930:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349805.418992:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666765056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349805.419001:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783349805.419092:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320f70c2d80 x1869977666765056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349805.419111:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666765056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349805.738094:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349806.762729:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349807.786011:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349808.490248:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666765184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349808.490341:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349808.490487:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765184 00000100:00100000:1.0:1783349808.490497:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765184 00000100:00100000:1.0:1783349808.490575:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783349808.490586:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666765184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349808.490635:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349808.490692:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666765184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349808.490698:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1783349808.490841:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349808.490885:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666765184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349808.732756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349808.732835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349808.732872:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349808.732990:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349808.733025:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203200 00000100:00100000:3.0:1783349808.733029:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203072 00000100:00100000:1.0:1783349808.733034:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203200 00000100:00100000:3.0:1783349808.733037:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203072 00000100:00100000:3.0:1783349808.733102:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203328 00000100:00100000:3.0:1783349808.733106:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203328 00000100:00100000:2.0:1783349808.733113:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:2.0:1783349808.733132:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655203072:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349808.733216:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655203072:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 93us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349808.733224:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:0.0:1783349808.733380:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655202944 00000100:00100000:0.0:1783349808.733389:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655202944 00000100:00100000:0.0:1783349808.733419:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 258 00000100:00100000:0.0:1783349808.733427:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655202944:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349808.733462:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655202944:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349808.733469:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 258 00000100:00100000:1.0:1783349808.735699:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:1.0:1783349808.735718:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655203200:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349808.735841:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655203200:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 129us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349808.735848:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:3.0:1783349808.735916:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:3.0:1783349808.735941:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655203328:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:2.0:1783349808.736074:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349808.736083:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349808.736102:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655203328:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 164us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349808.736111:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00010000:00010000:2.0:1783349808.810079:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349809.834137:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349810.026356:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666765568:0@lo:400:kworker.0 00000100:00100000:2.0:1783349810.026429:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349810.026505:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349810.026512:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666765696:0@lo:400:kworker.0 00000100:00100000:2.0:1783349810.026539:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349810.026631:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765568 00000100:00100000:1.0:1783349810.026642:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765568 00000100:00100000:1.0:1783349810.026720:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783349810.026733:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666765568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349810.026825:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666765440:0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.026830:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666765568:12345-0@lo:400:kworker.0 Request processed in 98us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.026865:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783349810.026869:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349810.026891:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765440 00000100:00100000:1.0:1783349810.026897:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765440 00000100:00100000:0.0:1783349810.026898:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666765952:0@lo:400:kworker.0 00000100:00100000:0.0:1783349810.026925:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349810.026935:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783349810.026945:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666765440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349810.026956:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783349810.026964:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666765312:0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.026985:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666765440:12345-0@lo:400:kworker.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.026993:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783349810.027000:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349810.027027:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666765824:0@lo:400:kworker.0 00000100:00100000:0.0:1783349810.027050:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349810.027077:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765312 00000100:00100000:1.0:1783349810.027082:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765312 00000100:00100000:0.0:1783349810.027090:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666765440:0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.027120:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783349810.027128:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666765312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349810.027139:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765824 00000100:00100000:0.0:1783349810.027150:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765824 00000100:00100000:1.0:1783349810.027172:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666765312:12345-0@lo:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.027180:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783349810.027209:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765696 00000100:00100000:1.0:1783349810.027212:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765696 00000100:00100000:1.0:1783349810.027249:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666765952 00000100:00100000:1.0:1783349810.027252:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666765952 00000100:00100000:1.0:1783349810.027273:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783349810.027280:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666765696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.027311:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666765696:12345-0@lo:400:kworker.0 Request processed in 31us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.027317:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783349810.027327:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783349810.027332:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666765952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.027389:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666765952:12345-0@lo:400:kworker.0 Request processed in 55us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.027395:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783349810.027431:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666765312:0@lo:400:kworker.0 00010000:00080000:1.0:1783349810.027445:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320fb4d0a80 x1869977666765952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349810.027456:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666765952:0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.027494:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349810.027501:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349810.027537:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666765824:12345-0@lo:400:kworker.0 Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.027543:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349810.027567:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666765824:0@lo:400:kworker.0 00000100:00080000:2.0:1783349810.028132:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349810.028137:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349810.028140:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349810.028163:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666765696:0@lo:400:kworker.0 00000100:00100000:2.0:1783349810.028173:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666765568:0@lo:400:kworker.0 00000100:00100000:3.0:1783349810.541092:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349810.541134:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666766080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349810.541211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349810.541365:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766080 00000100:00100000:1.0:1783349810.541374:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766080 00000100:00100000:1.0:1783349810.541446:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783349810.541459:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666766080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349810.541502:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349810.541567:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666766080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349810.541575:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1783349810.541737:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba0700 x1869977666766080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349810.541759:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666766080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783349810.857971:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783349810.858463:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783349811.882001:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349812.906507:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349813.610158:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666766208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349813.610260:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349813.613180:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766208 00000100:00100000:1.0:1783349813.613200:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766208 00000100:00100000:1.0:1783349813.613317:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783349813.613330:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666766208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349813.613396:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349813.613507:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666766208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349813.613515:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783349813.613628:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666766208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783349813.613684:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349813.855920:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349813.856012:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349813.856706:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203584 00000100:00100000:1.0:1783349813.856721:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203584 00000100:00100000:1.0:1783349813.856853:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:1.0:1783349813.856865:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655203584:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349813.856956:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655203584:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 95us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349813.856963:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:2.0:1783349813.857445:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203456 00000100:00100000:2.0:1783349813.857451:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203456 00000100:00100000:2.0:1783349813.857617:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00100000:2.0:1783349813.857625:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655203456:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349813.857665:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655203456:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 41us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349813.857684:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 260 00000100:00080000:3.0:1783349813.859336:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349813.866719:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349813.867010:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203712 00000100:00100000:1.0:1783349813.867025:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203712 00000100:00100000:1.0:1783349813.867112:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:1.0:1783349813.867124:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2358:x1869977655203712:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:1.0:1783349813.867166:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484763e6 00000100:00080000:1.0:1783349813.867175:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9320d155e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783349813.867223:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1783349813.867589:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349813.867646:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+2:2358:x1869977655203712:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 522us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349813.867654:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00080000:3.0:1783349813.867748:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349813.868005:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349813.868238:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203840 00000100:00100000:3.0:1783349813.868245:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203840 00000100:00100000:3.0:1783349813.868355:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:3.0:1783349813.868364:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+5:2359:x1869977655203840:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349813.868408:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+5:2359:x1869977655203840:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 45us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349813.868414:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00080000:2.0:1783349813.869006:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783349813.931313:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783349814.182051:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:3.0:1783349814.182061:0:6607:0:(genops.c:906:class_export_put()) final put ffff9320d1559000/ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:2.0:1783349814.182272:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320d1559000/ed421ea5-67f7-4096-abd5-85a5a23dfd60 for lustre-OST0000 00000020:00000080:2.0:1783349814.182338:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320d155e800 for lustre-OST0000 00010000:00010000:2.0:1783349814.954941:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349815.147650:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666766464:0@lo:400:kworker.0 00000100:00100000:1.0:1783349815.147729:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349815.147817:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349815.147824:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766464 00000100:00100000:1.0:1783349815.147825:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666766336:0@lo:400:kworker.0 00000100:00100000:2.0:1783349815.147836:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766464 00000100:00100000:1.0:1783349815.147876:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349815.147912:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783349815.147924:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766336 00000100:00100000:2.0:1783349815.147926:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666766464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349815.147930:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766336 00000100:00100000:1.0:1783349815.147965:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783349815.147973:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666766336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349815.148016:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1869977666766464:12345-0@lo:400:kworker.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349815.148022:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666766336:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349815.148028:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783349815.148034:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783349815.148169:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666766720:0@lo:400:kworker.0 00000100:00100000:0.0:1783349815.148204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349815.148251:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666766592:0@lo:400:kworker.0 00000100:00100000:2.0:1783349815.148279:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349815.149820:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666766848:0@lo:400:kworker.0 00000100:00100000:3.0:1783349815.149883:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349815.150007:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666766976:0@lo:400:kworker.0 00000100:00100000:0.0:1783349815.151248:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766720 00000100:00100000:0.0:1783349815.151260:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766720 00000100:00100000:0.0:1783349815.151332:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349815.151342:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666766720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349815.151430:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666766720:12345-0@lo:400:kworker.0 Request processed in 77us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349815.151439:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349815.151483:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666766720:0@lo:400:kworker.0 00000100:00100000:1.0:1783349815.151555:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349815.151590:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666766336:0@lo:400:kworker.0 00000100:00100000:1.0:1783349815.151604:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1869977666766464:0@lo:400:kworker.0 00000100:00100000:1.0:1783349815.151627:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766976 00000100:00100000:1.0:1783349815.151631:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766976 00000100:00100000:1.0:1783349815.151656:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349815.151662:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666766976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349815.151764:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666766976:12345-0@lo:400:kworker.0 Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349815.151771:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1783349815.151824:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba0e00 x1869977666766976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349815.151836:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666766976:0@lo:400:kworker.0 00000100:00080000:2.0:1783349815.156132:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349815.156147:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349815.156930:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766592 00000100:00100000:0.0:1783349815.156944:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766592 00000100:00100000:0.0:1783349815.158281:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666766848 00000100:00100000:0.0:1783349815.158297:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666766848 00000100:00080000:2.0:1783349815.158459:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349815.162181:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783349815.162214:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666766592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349815.162329:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666766592:12345-0@lo:400:kworker.0 Request processed in 135us (14048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349815.162614:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783349815.162628:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666766848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349815.162679:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666766848:12345-0@lo:400:kworker.0 Request processed in 54us (12795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349815.162686:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783349815.162750:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666766592:0@lo:400:kworker.0 00000100:00100000:2.0:1783349815.162837:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666766848:0@lo:400:kworker.0 00000100:00100000:0.0:1783349815.164267:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783349815.658022:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349815.658060:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666767104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349815.658162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349815.658387:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767104 00000100:00100000:3.0:1783349815.658395:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767104 00000100:00100000:3.0:1783349815.658453:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783349815.658463:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666767104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349815.658520:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349815.658585:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666767104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349815.658593:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1783349815.658928:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba1880 x1869977666767104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349815.658953:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666767104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349815.979073:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349817.003544:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349818.039301:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349818.731382:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349818.731411:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666767232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349818.731509:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349818.731637:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767232 00000100:00100000:1.0:1783349818.731645:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767232 00000100:00100000:1.0:1783349818.731703:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349818.731713:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666767232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349818.731753:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349818.731825:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666767232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349818.731832:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1783349818.732048:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349818.732085:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666767232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349818.977354:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349818.977476:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655203968 00000100:00100000:1.0:1783349818.977488:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655203968 00000100:00100000:1.0:1783349818.977556:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:1.0:1783349818.977567:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655203968:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349818.978830:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349818.978893:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349818.978930:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c75bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2361:x1869977655203968:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 1360us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349818.978941:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 262 00000100:00100000:3.0:1783349818.979012:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204224 00000100:00100000:3.0:1783349818.979020:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204224 00000100:00100000:1.0:1783349818.979036:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204096 00000100:00100000:1.0:1783349818.979041:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204096 00000100:00100000:1.0:1783349818.979090:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00080000:2.0:1783349818.979124:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349818.979187:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:1.0:1783349818.981451:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655204096:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349818.981571:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655204096:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 2472us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349818.981582:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:3.0:1783349818.982367:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655204224:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349818.982619:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2361:x1869977655204224:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 3424us (3795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349818.982628:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00010000:00010000:2.0:1783349819.049978:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349820.075144:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783349820.075551:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349820.265980:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666767360:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.266051:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349820.266244:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349820.266252:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666767488:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.266285:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349820.266367:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767488 00000100:00100000:1.0:1783349820.266375:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767488 00000100:00100000:1.0:1783349820.266440:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783349820.266450:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349820.266516:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666767488:12345-0@lo:400:kworker.0 Request processed in 68us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349820.266533:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783349820.266659:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666767488:0@lo:400:kworker.0 00000100:00100000:3.0:1783349820.266747:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767360 00000100:00100000:3.0:1783349820.266752:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767360 00000100:00100000:3.0:1783349820.266823:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783349820.266833:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666767360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.267246:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666767616:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.267276:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349820.267381:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767616 00000100:00100000:1.0:1783349820.267386:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767616 00000100:00100000:1.0:1783349820.267431:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783349820.267439:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666767616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349820.267624:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666767616:12345-0@lo:400:kworker.0 Request processed in 185us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349820.267631:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783349820.267697:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666767616:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.267711:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349820.267717:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666767744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.267758:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349820.267816:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349820.267862:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767744 00000100:00100000:1.0:1783349820.267866:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767744 00000100:00100000:1.0:1783349820.267908:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783349820.267915:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349820.267951:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666767744:12345-0@lo:400:kworker.0 Request processed in 37us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349820.267957:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783349820.268009:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349820.268031:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666767744:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.268052:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666767872:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.268079:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349820.268134:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666767872 00000100:00100000:1.0:1783349820.268139:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666767872 00000100:00100000:1.0:1783349820.268167:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783349820.268173:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666767872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349820.268206:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666767872:12345-0@lo:400:kworker.0 Request processed in 34us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349820.268213:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783349820.268236:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3291:x1869977666767360:12345-0@lo:400:kworker.0 Request processed in 1402us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349820.268245:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783349820.268372:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666768000:0@lo:400:kworker.0 00000100:00100000:0.0:1783349820.268417:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349820.268769:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666767360:0@lo:400:kworker.0 00000100:00100000:2.0:1783349820.268828:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666767872:0@lo:400:kworker.0 00000100:00080000:2.0:1783349820.268848:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349820.269599:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666768000 00000100:00100000:1.0:1783349820.269606:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666768000 00000100:00100000:1.0:1783349820.269700:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783349820.269709:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666768000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349820.269819:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666768000:12345-0@lo:400:kworker.0 Request processed in 111us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349820.269827:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1783349820.269916:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba2680 x1869977666768000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783349836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349820.269931:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666768000:0@lo:400:kworker.0 00000100:00080000:2.0:1783349820.270032:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1783349820.451585:0:11682:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:56:58 (1783349818) 00000100:00100000:2.0:1783349820.779174:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666768128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349820.779287:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349820.779422:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666768128 00000100:00100000:1.0:1783349820.779431:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666768128 00000100:00100000:1.0:1783349820.779515:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783349820.779528:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666768128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349820.779578:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349820.784335:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666768128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4786us (5026us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349820.784351:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1783349820.785920:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9320faba2680 x1869977666768128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349820.785943:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666768128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783349821.101609:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349821.455486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349821.455856:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204352 00000100:00100000:1.0:1783349821.455871:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204352 00000100:00080000:2.0:1783349821.455928:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349821.456004:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:1.0:1783349821.456023:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:10196:x1869977655204352:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349821.456045:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349821.456076:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484764b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b99e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.456144:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484764b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.456157:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484764b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.456170:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484764b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349821.456384:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783349821.456389:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349821.456549:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484764b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.456576:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484764b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b99e expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.456595:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484764b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b99e expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.456604:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320e0103400) 00010000:00010000:1.0:1783349821.456607:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349821.456611:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacaa00, rc 0) 00000100:00100000:1.0:1783349821.456713:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:10196:x1869977655204352:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 699us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349821.456721:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:0.0:1783349821.466770:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349821.467145:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204480 00000100:00100000:3.0:1783349821.467155:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204480 00000100:00100000:3.0:1783349821.467388:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:3.0:1783349821.467400:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:10197:x1869977655204480:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349821.467425:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349821.467461:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484764bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9a5 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.467536:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.467551:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.467562:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.467578:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.467586:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.467592:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.468635:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484764d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.468652:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484764d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.468661:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484764d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349821.468911:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783349821.468916:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349821.468998:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484764d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469016:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469022:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469029:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469035:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349821.469039:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469046:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469060:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320e0103400) 00010000:00010000:3.0:1783349821.469064:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349821.469068:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469075:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484764c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469089:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469096:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469102:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469112:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349821.469116:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469122:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469129:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9320cf8b3400) 00010000:00010000:3.0:1783349821.469132:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349821.469135:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.469140:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484764cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.471082:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484764bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9a5 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.471119:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484764d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9a5 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349821.471129:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9320cf8b3300) 00010000:00010000:3.0:1783349821.471133:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349821.471136:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003800, rc 0) 00000100:00100000:3.0:1783349821.471226:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:10197:x1869977655204480:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3827us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349821.471236:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:0.0:1783349821.475072:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349821.477063:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204736 00000100:00100000:1.0:1783349821.477078:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204736 00000100:00100000:1.0:1783349821.477162:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:1.0:1783349821.477177:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:10197:x1869977655204736:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349821.477210:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349821.477252:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484764db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9ac expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.477353:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.477400:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.477414:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.477488:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.477497:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.477504:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478103:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484764f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478117:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484764f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478124:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484764f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349821.478135:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783349821.478343:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478351:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478358:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478382:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349821.478387:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478395:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478408:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9320cf8b3300) 00010000:00010000:1.0:1783349821.478411:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349821.478417:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478423:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484764e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478448:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478455:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478461:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478466:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349821.478469:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478475:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478500:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9320e0103a00) 00010000:00010000:1.0:1783349821.478503:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349821.478507:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478515:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484764e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478936:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484764db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9ac expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478952:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484764f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9ac expref: 9 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349821.478959:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:1.0:1783349821.478962:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349821.478964:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacbe00, rc 0) 00000100:00100000:1.0:1783349821.479047:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10197:x1869977655204736:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1873us (3984us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783349821.479057:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:2.0:1783349821.482938:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349821.483082:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204864 00000100:00100000:0.0:1783349821.483093:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204864 00000100:00100000:0.0:1783349821.483218:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:0.0:1783349821.483242:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10197:x1869977655204864:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783349821.483367:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10197:x1869977655204864:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 139us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349821.483387:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00010000:00010000:3.0:1783349822.122163:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783349822.122419:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783349822.630493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349822.630580:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655204992 00000100:00100000:1.0:1783349822.630590:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655204992 00000100:00100000:1.0:1783349822.630644:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:1.0:1783349822.630654:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10239:x1869977655204992:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349822.630672:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349822.630693:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484764fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9b3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.630760:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.630773:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.630784:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.630887:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.630897:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.630904:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631144:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631153:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631159:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631166:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349822.631170:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631187:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631199:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320e0103400) 00010000:00010000:1.0:1783349822.631201:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349822.631206:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631226:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631237:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631243:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631249:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631254:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349822.631257:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631263:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631271:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9320e0103a00) 00010000:00010000:1.0:1783349822.631274:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349822.631277:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631290:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847650c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631322:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484764fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9b3 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631332:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320e0103400) 00010000:00010000:1.0:1783349822.631334:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349822.631338:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484764fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9b3 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.631347:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca200, rc 0) 00000100:00100000:1.0:1783349822.631416:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10239:x1869977655204992:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 764us (930us total) trans 0 rc 301/301 00000100:00100000:1.0:1783349822.631424:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:1.0:1783349822.639840:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.640030:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655205248 00000100:00100000:0.0:1783349822.640044:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655205248 00000100:00100000:0.0:1783349822.640143:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:0.0:1783349822.640154:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10239:x1869977655205248:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1783349822.640235:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349822.640266:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484764b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b99e expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.640284:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320e0103400) 00010000:00010000:0.0:1783349822.640300:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349822.640666:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.640680:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.640690:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.640703:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.640711:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.640719:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349822.647900:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783349822.647922:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.647934:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.647941:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.648281:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175aa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349822.648287:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.648296:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.648315:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913500) 00010000:00010000:0.0:1783349822.648319:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349822.648326:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.648333:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476513 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349822.648366:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007be75acc reply state 00000000140a14e7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349822.648378:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349822.649126:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:10239:x1869977655205248:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 8968us (9291us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783349822.649136:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00010000:00010000:0.0:1783349822.651674:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.651692:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.651700:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.651719:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175ac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349822.651724:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.651732:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.651747:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9320c2913200) 00010000:00010000:0.0:1783349822.651751:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349822.651755:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.651762:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847651a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.708516:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.708678:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655205376 00000100:00100000:0.0:1783349822.708690:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655205376 00000100:00100000:0.0:1783349822.708749:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:0.0:1783349822.708760:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10247:x1869977655205376:12345-192.168.204.36@tcp:101:lctl.0 00010000:00010000:0.0:1783349822.708844:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349822.708871:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9ba expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.708939:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.708952:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.708980:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349822.709038:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783349822.709042:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349822.709082:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.709124:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9ba expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.709142:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9ba expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.709151:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:0.0:1783349822.709154:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349822.709157:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175aa00, rc 0) 00000100:00100000:0.0:1783349822.709214:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:10247:x1869977655205376:12345-192.168.204.36@tcp:101:lctl.0 Request processed in 457us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349822.709222:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:2.0:1783349822.741830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.741913:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655205504 00000100:00100000:0.0:1783349822.741978:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655205504 00000100:00100000:0.0:1783349822.742431:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:0.0:1783349822.742443:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:10253:x1869977655205504:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349822.742465:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349822.742486:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847652f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9c1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742572:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742585:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742595:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742607:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742614:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742621:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742883:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b600/0x68b4a22a48476544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742895:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b600/0x68b4a22a48476544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742902:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b600/0x68b4a22a48476544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349822.742931:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783349822.742934:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349822.742969:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b600/0x68b4a22a48476544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742990:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.742997:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743004:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743010:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175bc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349822.743014:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743020:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743031:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:0.0:1783349822.743033:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349822.743037:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743043:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a48476536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743054:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743060:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743066:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743075:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175a600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349822.743078:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743084:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743090:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9320c2913500) 00010000:00010000:0.0:1783349822.743092:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349822.743095:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743100:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a4847653d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743127:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847652f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c1 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743138:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b600/0x68b4a22a48476544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c1 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.743145:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349822.743147:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783349822.743149:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175b600, rc 0) 00000100:00100000:0.0:1783349822.743202:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:10253:x1869977655205504:12345-192.168.204.36@tcp:101:bash.0 Request processed in 762us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349822.743210:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:2.0:1783349822.746117:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349822.746180:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655205760 00000100:00100000:1.0:1783349822.746190:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655205760 00000100:00100000:1.0:1783349822.746246:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:1.0:1783349822.746256:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:10253:x1869977655205760:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349822.746278:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349822.746369:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847654b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9c8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.746534:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.746563:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.746575:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.746639:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.746648:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.746656:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349822.747697:0:5784:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783349822.747991:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748005:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748014:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748052:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748059:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748066:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748080:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349822.748085:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748093:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748107:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349822.748109:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349822.748114:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748120:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476552 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349822.748134:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008555de11 reply state 000000006a18e2ca transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.748142:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783349822.748175:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847654b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748190:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.748197:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:1.0:1783349822.748199:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349822.748202:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca600, rc 0) 00000100:00100000:1.0:1783349822.748406:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10253:x1869977655205760:12345-192.168.204.36@tcp:101:bash.0 Request processed in 2150us (2294us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783349822.748421:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 39 00010000:00010000:3.0:1783349822.749736:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.749747:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.749751:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.749754:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349822.749757:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.749762:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.749772:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320e0103a00) 00010000:00010000:3.0:1783349822.749774:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349822.749777:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.749783:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476559 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349822.753052:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349822.753459:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655205888 00000100:00100000:1.0:1783349822.753470:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655205888 00000100:00100000:1.0:1783349822.753534:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:1.0:1783349822.753545:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1869977655205888:12345-192.168.204.36@tcp:8:bash.0 00010000:00080000:1.0:1783349822.753580:0:6579:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1783349822.753611:0:6579:0:(genops.c:1406:class_connect()) connect: client ed421ea5-67f7-4096-abd5-85a5a23dfd60, cookie 0x68b4a22a4847656e 00002000:00100000:1.0:1783349822.753623:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed421ea5-67f7-4096-abd5-85a5a23dfd60/ffff9320d0b57800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783349822.753647:0:6579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783349822.754120:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783349822.754153:0:6579:0:(import.c:65:import_set_state_nolock()) ffff9320c8e74800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349822.754239:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2358:x1869977655205888:12345-192.168.204.36@tcp:8:bash.0 Request processed in 694us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349822.754248:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:1.0:1783349822.756385:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349822.756519:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655206016 00000100:00100000:2.0:1783349822.756529:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655206016 00000100:00100000:2.0:1783349822.756628:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:2.0:1783349822.756639:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:0:x1869977655206016:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349822.756657:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349822.756680:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9cf expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349822.756714:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349822.756730:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=209s v=(0 0) 00010000:00010000:2.0:1783349822.756734:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349822.756741:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 7 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.756764:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 7 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.756776:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96000, rc 0) 00000100:00080000:0.0:1783349822.756862:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349822.756878:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:0:x1869977655206016:12345-192.168.204.36@tcp:101:bash.0 Request processed in 239us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349822.756886:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:2.0:1783349822.763936:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349822.764575:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655206144 00000100:00100000:1.0:1783349822.764586:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655206144 00000100:00100000:1.0:1783349822.764643:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:1.0:1783349822.764654:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:10253:x1869977655206144:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349822.764674:0:7807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349822.764694:0:7807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9d6 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.764724:0:7807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.764752:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349822.764756:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349822.764762:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 8 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.764843:0:7807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.764858:0:7807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.764873:0:7807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c9035500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7807:1869977666768256:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349822.764973:0:7807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7ece6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349822.768772:0:7807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c9035500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7807:1869977666768256:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349822.769134:0:7807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 8 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.769164:0:7807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349822.769273:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:10253:x1869977655206144:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4618us (5344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349822.769286:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:2.0:1783349822.769522:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349822.769633:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655206272 00000100:00100000:3.0:1783349822.769644:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655206272 00010000:00010000:3.0:1783349822.769688:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349822.769731:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:3.0:1783349822.769741:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655206272:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349822.769784:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349822.769848:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.769861:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.769933:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d049c2/0x68b4a22a48476575 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9cf expref: 8 pid: 6578 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.769952:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349822.769957:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349822.769967:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.769980:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.770034:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349822.770124:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5771:1869977666768384:192.168.204.36@tcp:105: 00000100:00100000:3.0:1783349822.770364:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349822.773474:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5771:1869977666768384:192.168.204.36@tcp:105: 00010000:00010000:1.0:1783349822.773519:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349822.773606:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655206272:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3865us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349822.773620:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:3.0:1783349822.774708:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.774863:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655206528 00000100:00100000:0.0:1783349822.774873:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655206528 00000100:00100000:2.0:1783349822.775084:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:2.0:1783349822.775100:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10253:x1869977655206528:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:2.0:1783349822.775630:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10253:x1869977655206528:12345-192.168.204.36@tcp:35:bash.0 Request processed in 531us (923us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783349822.775640:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:2.0:1783349822.816868:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349822.817065:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655206784 00000100:00100000:3.0:1783349822.817098:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655206784 00000100:00100000:3.0:1783349822.817219:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:3.0:1783349822.817231:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10263:x1869977655206784:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349822.817266:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349822.817292:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9dd expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349822.817462:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783349822.817629:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476583 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9dd expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.817647:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:3.0:1783349822.817651:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349822.817658:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9dd expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.817678:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002600, rc 0) 00000100:00100000:3.0:1783349822.817766:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:10263:x1869977655206784:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 533us (909us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1783349822.817775:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:2.0:1783349822.824196:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.824319:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655207040 00000100:00100000:0.0:1783349822.824331:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655207040 00000100:00100000:0.0:1783349822.825847:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:0.0:1783349822.825874:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:10263:x1869977655207040:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349822.826286:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:10263:x1869977655207040:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 424us (2105us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783349822.826295:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:2.0:1783349822.885773:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.885934:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655207168 00000100:00100000:0.0:1783349822.885951:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655207168 00000100:00100000:0.0:1783349822.886113:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:0.0:1783349822.886128:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:10269:x1869977655207168:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349822.886163:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349822.886190:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9e4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.886288:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a48476598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.886307:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a48476598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.886322:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a48476598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349822.886420:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783349822.886424:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349822.886453:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a48476598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.886519:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9e4 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.886542:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a48476598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9e4 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.886553:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349822.886556:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349822.886561:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175a600, rc 0) 00000100:00100000:0.0:1783349822.886656:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:10269:x1869977655207168:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 533us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349822.886664:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:1.0:1783349822.890879:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.892714:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655207424 00000100:00100000:0.0:1783349822.892737:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655207424 00000100:00100000:0.0:1783349822.892898:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:0.0:1783349822.892912:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:10269:x1869977655207424:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349822.892942:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349822.892973:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847659f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9eb expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.893168:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a484765a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.893187:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a484765a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.893202:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a484765a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349822.893226:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783349822.893414:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a4847659f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9eb expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.893434:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a484765a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9eb expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.893443:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:0.0:1783349822.893446:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349822.893450:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175bc00, rc 0) 00000100:00100000:0.0:1783349822.893556:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10269:x1869977655207424:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 647us (2694us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783349822.893564:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:2.0:1783349822.897693:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349822.898016:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655207680 00000100:00100000:1.0:1783349822.898030:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655207680 00000100:00100000:1.0:1783349822.898101:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1783349822.898113:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10269:x1869977655207680:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349822.898148:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349822.898176:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484765b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9f2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.899380:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484765bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.899406:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484765bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.899422:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484765bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349822.899439:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:2.0:1783349822.899849:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349822.900481:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655207808 00000100:00100000:3.0:1783349822.900494:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655207808 00000100:00100000:3.0:1783349822.900583:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:3.0:1783349822.900595:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:2359:x1869977655207808:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349822.900615:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349822.900641:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a484765a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9eb expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.900689:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:3.0:1783349822.900696:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349822.900780:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:2359:x1869977655207808:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 188us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349822.900789:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00010000:00010000:1.0:1783349822.901836:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484765b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f2 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.901871:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484765bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f2 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.901879:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:1.0:1783349822.901896:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783349822.901900:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacbc00, rc 0) 00000100:00100000:1.0:1783349822.901958:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:10269:x1869977655207680:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3848us (4281us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1783349822.901966:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:2.0:1783349822.914738:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349822.914873:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655207936 00000100:00100000:3.0:1783349822.914887:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655207936 00000100:00100000:3.0:1783349822.915002:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:3.0:1783349822.915015:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655207936:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:3.0:1783349822.915078:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.915119:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.915131:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349822.915135:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349822.915141:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.915188:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.915204:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 7 pid: 7807 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349822.915245:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6580:1869977666768512:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349822.915398:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349822.923673:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6580:1869977666768512:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349822.923728:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349822.929207:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349822.929598:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655208064 00000100:00100000:3.0:1783349822.929616:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655208064 00002000:00100000:3.0:1783349822.929687:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9320c750ca80 x1869977655208064/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:573/0 lens 504/0 e 0 to 0 dl 1783349833 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349822.929700:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320c750ca80 with x1869977655208064 ext(0->12) 00010000:00010000:3.0:1783349822.929711:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 8 pid: 7807 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.929733:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 8 pid: 7807 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349822.929742:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320c750ca80 00000100:00100000:2.0:1783349822.931530:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:2.0:1783349822.931560:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655208064:12345-192.168.204.36@tcp:4:lfs.0 00000001:00100000:0.0:1783349822.960664:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000100:00100000:3.0:1783349822.961741:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655208064:12345-192.168.204.36@tcp:4:lfs.0 Request processed in 30185us (32531us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783349822.961756:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00002000:00100000:3.0:1783349822.961772:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9320c750ca80 x1869977655208064/t4294967299(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:573/0 lens 504/448 e 0 to 0 dl 1783349833 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349822.962073:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320c750ca80 with x1869977655208064 ext(0->12) 00010000:00010000:3.0:1783349822.962087:0:6585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 9 pid: 7807 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.962109:0:6585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 9 pid: 7807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349822.962120:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320c750ca80 00000100:00100000:0.0:1783349822.964714:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349822.965882:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655208192 00000100:00100000:1.0:1783349822.965896:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655208192 00010000:00010000:1.0:1783349822.965949:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 9 pid: 7807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.965991:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:1.0:1783349822.966001:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2360:x1869977655208192:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349822.966018:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783349822.966043:0:5771:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783349822.966047:0:5771:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783349821 00002000:00010000:1.0:1783349822.966050:0:5771:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783349822 00002000:00010000:1.0:1783349822.966052:0:5771:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783349821 00010000:00010000:1.0:1783349822.966060:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 9 pid: 7807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.966075:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 9 pid: 7807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.966110:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c338ebbf/0x68b4a22a4847657c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9d6 expref: 9 pid: 7807 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.966131:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1783349822.966152:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349822.966159:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.966171:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349822.966218:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349822.966238:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.966252:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.966283:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.966293:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.966296:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2360:x1869977655208192:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 293us (1594us total) trans 0 rc 0/0 00010000:00010000:3.0:1783349822.966312:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.966313:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00010000:00010000:3.0:1783349822.966324:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349822.966330:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.966362:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.966375:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.966391:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484765c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349822.966460:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655207936:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 51447us (51735us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349822.966469:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:1.0:1783349822.968705:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349822.969046:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655208448 00000100:00100000:2.0:1783349822.969058:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655208448 00000100:00100000:2.0:1783349822.969115:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:2.0:1783349822.969126:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:10269:x1869977655208448:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:2.0:1783349822.969221:0:5788:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484765bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f2 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349822.969634:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1783349822.969711:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1783349822.971263:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1783349822.971465:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.971487:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.971495:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.971591:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.971605:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 24 pid: 5784 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349822.971626:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5788:1869977666768640:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349822.971844:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349822.975614:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5788:1869977666768640:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349822.975652:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349822.979327:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349822.979974:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655208576 00000100:00100000:2.0:1783349822.979988:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655208576 00010000:00010000:2.0:1783349822.980043:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 25 pid: 5784 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349822.980098:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:2.0:1783349822.980110:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+25:2361:x1869977655208576:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349822.980130:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349822.980138:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 25 pid: 5784 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.980154:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 25 pid: 5784 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.980194:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48476560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c8 expref: 25 pid: 5784 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.980214:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:2.0:1783349822.980221:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.980232:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.980262:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349822.980305:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349822.980383:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.980394:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349822.980400:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:2361:x1869977655208576:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 291us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349822.980412:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000001:00080000:0.0:1783349822.980572:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783349822.981030:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1783349822.981216:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666768768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349822.981303:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349822.981336:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca1b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349822.982056:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666768768 00000100:00100000:3.0:1783349822.982067:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666768768 00000100:00100000:3.0:1783349822.982139:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349822.982149:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1869977666768768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1783349822.982223:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349822.982427:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1869977666768768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 278us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349822.982499:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349822.982974:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666768768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783349822.983835:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1783349822.983947:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666768896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349822.984020:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349822.984200:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1783349822.985194:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666768896 00000100:00100000:1.0:1783349822.985209:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666768896 00000100:00100000:1.0:1783349822.985279:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349822.985290:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5788:x1869977666768896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783349822.985872:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5788:x1869977666768896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 503us (1772us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783349822.985882:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349822.986639:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666768896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783349822.986751:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1783349822.986891:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.986903:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.986910:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.986917:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349822.986922:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.986930:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.986948:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:0.0:1783349822.986952:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783349822.986975:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349822.986982:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484765d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349822.987229:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783349822.987507:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1783349822.987519:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 210049725885ns, next at 211049724012ns, rc = 0 00000001:00080000:0.0:1783349822.987524:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1783349822.987554:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320e0103500) 00010000:00010000:0.0:1783349822.987557:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783349822.987565:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484765bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f2 expref: 28 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349822.987686:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:10269:x1869977655208448:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 18562us (18991us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783349822.987694:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00000020:00080000:0.0:1783349822.987699:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783349822.990302:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349822.990406:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655208704 00000100:00100000:3.0:1783349822.990484:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655208704 00000100:00100000:3.0:1783349822.990548:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:3.0:1783349822.990559:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:10269:x1869977655208704:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349822.990590:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349822.990620:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484765d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6b9f9 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.990723:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484765d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f9 expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.990741:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484765d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f9 expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349822.990765:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:3.0:1783349822.990768:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349822.990773:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002600, rc 0) 00000100:00100000:3.0:1783349822.991022:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:10269:x1869977655208704:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 464us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349822.991031:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:2.0:1783349822.994402:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349822.994486:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655208960 00000100:00100000:0.0:1783349822.994500:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655208960 00000100:00100000:0.0:1783349822.995690:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:0.0:1783349822.995707:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:10269:x1869977655208960:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349822.996062:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:10269:x1869977655208960:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 360us (1671us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1783349822.996072:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:1.0:1783349823.055668:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.055874:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655209216 00000100:00100000:0.0:1783349823.055888:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655209216 00000100:00100000:0.0:1783349823.055985:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:0.0:1783349823.056017:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:10279:x1869977655209216:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349823.056049:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349823.056076:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ba00/0x68b4a22a484765de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba00 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783349823.056125:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1783349823.056239:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783349823.056407:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ba00/0x68b4a22a484765de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba00 expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.056424:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:0.0:1783349823.056427:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349823.056433:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ba00/0x68b4a22a484765de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba00 expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.056450:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320d175ba00, rc 0) 00000100:00100000:0.0:1783349823.056535:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:10279:x1869977655209216:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 522us (886us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1783349823.056544:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:0.0:1783349823.066556:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.066714:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655209344 00000100:00100000:2.0:1783349823.066731:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655209344 00000100:00100000:2.0:1783349823.066863:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:2.0:1783349823.066876:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:10279:x1869977655209344:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:2.0:1783349823.066981:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067004:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067019:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067036:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067043:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067051:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067205:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067214:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067222:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349823.067281:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067299:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067306:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067314:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067321:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349823.067326:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067334:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067363:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349823.067366:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349823.067372:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067387:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484765ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067404:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067410:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067416:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067420:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349823.067423:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067429:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067437:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c3886100) 00010000:00010000:2.0:1783349823.067451:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349823.067453:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067459:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484765f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067475:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067482:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067503:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067508:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349823.067511:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067517:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067524:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:2.0:1783349823.067527:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349823.067529:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.067535:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484765fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.067645:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:10279:x1869977655209344:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 770us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349823.067655:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:2.0:1783349823.073261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.073383:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655209600 00000100:00100000:0.0:1783349823.073397:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655209600 00000100:00100000:0.0:1783349823.073476:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:0.0:1783349823.073670:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:10279:x1869977655209600:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349823.074176:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:10279:x1869977655209600:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 688us (926us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1783349823.074185:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:1.0:1783349823.103016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.103128:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655209856 00000100:00100000:0.0:1783349823.103142:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655209856 00000100:00100000:0.0:1783349823.103219:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:0.0:1783349823.103233:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:10282:x1869977655209856:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349823.103271:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349823.103298:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ba00/0x68b4a22a48476601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba07 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103413:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103431:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103443:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103462:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103470:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103477:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103672:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103682:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103707:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349823.103719:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783349823.103886:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103895:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103902:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103908:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175ac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.103913:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103921:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103936:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349823.103940:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349823.103945:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103951:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ac00/0x68b4a22a48476608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103968:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103975:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103987:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.103993:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175bc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.103996:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.104002:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.104010:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913500) 00010000:00010000:0.0:1783349823.104013:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349823.104016:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.104022:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175bc00/0x68b4a22a4847660f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.104076:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175ba00/0x68b4a22a48476601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.104091:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 33 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.104098:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.104100:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349823.104103:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7a00, rc 0) 00000100:00100000:0.0:1783349823.104193:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10282:x1869977655209856:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 963us (1191us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1783349823.104212:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:2.0:1783349823.108485:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.109370:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655209984 00000100:00100000:0.0:1783349823.109387:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655209984 00000100:00100000:0.0:1783349823.109532:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:0.0:1783349823.109547:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10282:x1869977655209984:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1783349823.109654:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109677:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109690:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109728:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109736:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109742:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109750:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.109755:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109763:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109789:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.109829:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349823.109836:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.109843:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349823.109945:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10282:x1869977655209984:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 401us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349823.109953:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:2.0:1783349823.112181:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.112276:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655210240 00000100:00100000:0.0:1783349823.112290:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655210240 00000100:00100000:0.0:1783349823.112368:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349823.112379:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10282:x1869977655210240:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349823.112690:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:10282:x1869977655210240:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 310us (522us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783349823.112698:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00010000:00010000:2.0:1783349823.146222:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349823.280908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.281029:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655210496 00000100:00100000:0.0:1783349823.281044:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655210496 00000100:00100000:0.0:1783349823.281187:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:0.0:1783349823.281200:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:10313:x1869977655210496:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1783349823.281236:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349823.281265:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a4847662b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba0e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.281431:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.281450:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.281484:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349823.281502:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783349823.281700:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a4847662b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba0e expref: 37 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.281720:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba0e expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.281729:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.281731:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349823.281735:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7800, rc 0) 00000100:00100000:0.0:1783349823.281854:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:10313:x1869977655210496:12345-192.168.204.36@tcp:101:cat.0 Request processed in 657us (962us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783349823.281862:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:1.0:1783349823.285057:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349823.285290:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655210624 00000100:00100000:3.0:1783349823.285317:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655210624 00000100:00100000:3.0:1783349823.285700:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:3.0:1783349823.285714:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:2361:x1869977655210624:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349823.285739:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349823.285786:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba0e expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.285842:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:3.0:1783349823.285848:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349823.285930:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:2361:x1869977655210624:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 220us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349823.285939:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:2.0:1783349823.286600:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.287436:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655210880 00000100:00100000:0.0:1783349823.287448:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655210880 00000100:00100000:0.0:1783349823.287509:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:0.0:1783349823.287520:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:10313:x1869977655210880:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:0.0:1783349823.287950:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:10313:x1869977655210880:12345-192.168.204.36@tcp:35:cat.0 Request processed in 431us (1353us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783349823.287957:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:1.0:1783349823.330366:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349823.330725:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655211136 00000100:00100000:3.0:1783349823.330742:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655211136 00000100:00100000:3.0:1783349823.330959:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:3.0:1783349823.330975:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:10319:x1869977655211136:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:3.0:1783349823.331012:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349823.331016:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783349823.331052:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175a600/0x68b4a22a48476598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9e4 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.331076:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349823.331082:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349823.331100:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476640 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba15 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.331261:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.331289:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.331300:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.331353:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.331369:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 36 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349823.331412:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666769024:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349823.331557:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349823.334825:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349823.335348:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666769024:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349823.335385:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.335634:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655211264 00000100:00100000:2.0:1783349823.335645:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655211264 00010000:00010000:2.0:1783349823.335695:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 37 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.335836:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:2.0:1783349823.335847:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:2362:x1869977655211264:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349823.335870:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349823.335878:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 37 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.335956:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 37 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.335984:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba07 expref: 37 pid: 5785 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.336004:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:2.0:1783349823.336010:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.336022:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.336030:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.336065:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349823.336094:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.336101:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349823.336125:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:2.0:1783349823.336139:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:2362:x1869977655211264:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 294us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349823.336146:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 38 00010000:00010000:3.0:1783349823.337037:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476640 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 37 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.337061:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 36 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.337069:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:3.0:1783349823.337072:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783349823.337075:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003a00, rc 0) 00000100:00100000:3.0:1783349823.337160:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:10319:x1869977655211136:12345-192.168.204.36@tcp:101:dd.0 Request processed in 6190us (6885us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783349823.337167:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:1.0:1783349823.340979:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.341597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655211520 00000100:00100000:2.0:1783349823.341632:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655211520 00000100:00100000:2.0:1783349823.341771:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:2.0:1783349823.341784:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:10319:x1869977655211520:12345-192.168.204.36@tcp:36:dd.0 00010000:00010000:2.0:1783349823.342714:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.342737:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.342750:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349823.343704:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1783349823.343766:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000954336c5 reply state 00000000e1abe0ab transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.343781:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349823.344188:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:10319:x1869977655211520:12345-192.168.204.36@tcp:36:dd.0 Request processed in 2401us (3219us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783349823.344200:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00000020:00080000:2.0:1783349823.344207:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783349823.350117:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.350140:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.350172:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.350180:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.350187:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.350196:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.350226:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.350230:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349823.350237:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.350244:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349823.531155:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.531285:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655211648 00000100:00100000:0.0:1783349823.531303:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655211648 00000100:00100000:0.0:1783349823.531412:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:0.0:1783349823.531424:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:10333:x1869977655211648:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:0.0:1783349823.531459:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349823.531496:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a4847665c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba1c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531616:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531635:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531671:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531693:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531713:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531722:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531893:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531905:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 39 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531915:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531967:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 39 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.531982:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 39 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349823.531999:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666769152:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349823.532156:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349823.535387:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.535534:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655211904 00000100:00100000:2.0:1783349823.535546:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655211904 00000100:00100000:2.0:1783349823.535638:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:2.0:1783349823.535650:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:5566:x1869977655211904:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783349823.536234:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:5566:x1869977655211904:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 580us (864us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1783349823.536243:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:0.0:1783349823.536733:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666769152:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349823.536779:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.541829:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.541931:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655212032 00000100:00100000:0.0:1783349823.541946:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655212032 00010000:00010000:0.0:1783349823.542008:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 41 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349823.542052:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:0.0:1783349823.542067:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:2361:x1869977655212032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349823.542133:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349823.542143:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 41 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.542160:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 41 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.542185:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476647 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba15 expref: 41 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.542203:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.542209:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.542219:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.542227:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.542278:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349823.542420:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:2361:x1869977655212032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 357us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349823.542429:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 39 00010000:00010000:2.0:1783349823.542629:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.542639:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349823.543203:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783349823.543210:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349823.543345:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543365:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543378:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543386:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543393:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543409:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349823.543414:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543422:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543596:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349823.543600:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349823.543606:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543626:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543643:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543650:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543656:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543661:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349823.543664:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543671:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543681:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913500) 00010000:00010000:2.0:1783349823.543684:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349823.543687:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543693:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847666a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543746:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a4847665c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba1c expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543763:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba1c expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.543779:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:2.0:1783349823.543782:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349823.543785:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:2.0:1783349823.543971:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:10333:x1869977655211648:12345-192.168.204.36@tcp:101:stat.0 Request processed in 12549us (12831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349823.543985:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:2.0:1783349823.599515:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.600301:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655212288 00000100:00100000:0.0:1783349823.600320:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655212288 00000100:00100000:0.0:1783349823.600467:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:0.0:1783349823.600482:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:10339:x1869977655212288:12345-192.168.204.36@tcp:36:truncate.0 00010000:00010000:0.0:1783349823.600567:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349823.600602:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba1c expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.600625:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.600631:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349823.600990:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.601008:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.601020:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349823.601077:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1783349823.601105:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d52bf353 reply state 00000000916cc369 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349823.601115:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349823.601462:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:10339:x1869977655212288:12345-192.168.204.36@tcp:36:truncate.0 Request processed in 982us (1964us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783349823.601471:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00000020:00080000:0.0:1783349823.601477:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349823.608106:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.608152:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.608160:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.608168:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349823.608266:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.608359:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.608384:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:3.0:1783349823.608387:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349823.608394:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.608401:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476678 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.715504:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349823.715876:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655212416 00000100:00100000:1.0:1783349823.715891:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655212416 00000100:00100000:1.0:1783349823.715979:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:1.0:1783349823.716002:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:10353:x1869977655212416:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:1.0:1783349823.716040:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349823.716066:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a4847667f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba23 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716153:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716170:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716183:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716199:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716206:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716212:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716383:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716416:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716423:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349823.716470:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1783349823.716475:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349823.716503:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716516:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716525:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716532:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716539:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716545:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349823.716550:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716557:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716572:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349823.716580:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349823.716586:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716592:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716611:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716617:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716624:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716629:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349823.716632:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716638:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716646:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320e0103900) 00010000:00010000:1.0:1783349823.716648:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349823.716651:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716656:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a4847668d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716693:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a4847667f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716719:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 41 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.716726:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:1.0:1783349823.716729:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349823.716732:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacaa00, rc 0) 00000100:00100000:1.0:1783349823.716918:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:10353:x1869977655212416:12345-192.168.204.36@tcp:101:stat.0 Request processed in 929us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349823.716927:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:0.0:1783349823.775519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.775638:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655212672 00000100:00100000:2.0:1783349823.775653:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655212672 00000100:00100000:2.0:1783349823.775730:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:2.0:1783349823.775743:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:10363:x1869977655212672:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349823.775774:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349823.775863:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847669b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba2a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349823.776045:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783349823.776214:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847669b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba2a expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.776231:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:2.0:1783349823.776234:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349823.776239:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847669b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba2a expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.776255:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96600, rc 0) 00000100:00100000:2.0:1783349823.776504:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+42:10363:x1869977655212672:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 763us (1000us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1783349823.776512:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:0.0:1783349823.782978:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.783176:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655212928 00000100:00100000:2.0:1783349823.783195:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655212928 00000100:00100000:2.0:1783349823.783292:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:2.0:1783349823.783305:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+42:10363:x1869977655212928:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1783349823.783856:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:10363:x1869977655212928:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 549us (888us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1783349823.783866:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:3.0:1783349823.830946:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.831131:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655213184 00000100:00100000:2.0:1783349823.831144:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655213184 00000100:00100000:2.0:1783349823.831210:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1783349823.831222:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:10369:x1869977655213184:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349823.831252:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349823.831282:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484766a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba31 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.831431:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.831449:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.831458:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.831501:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.831535:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 44 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.831551:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666769280:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349823.831724:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f300 going to sleep for 11 seconds 00000100:00100000:1.0:1783349823.834495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349823.834842:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655213312 00000100:00100000:3.0:1783349823.834856:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655213312 00010000:00010000:3.0:1783349823.834911:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 45 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349823.834964:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:3.0:1783349823.834976:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:2362:x1869977655213312:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349823.835014:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349823.835035:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 45 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.835051:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 45 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.835082:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:3.0:1783349823.835089:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.835101:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.835111:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.835137:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349823.835395:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:2362:x1869977655213312:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 420us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349823.835404:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 40 00010000:00010000:2.0:1783349823.838278:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba23 expref: 44 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.838309:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666769280:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349823.838350:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.838362:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.838369:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349823.838394:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1783349823.838619:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484766a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 45 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.838636:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.838646:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:2.0:1783349823.838665:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349823.838669:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96e00, rc 0) 00000100:00100000:2.0:1783349823.838766:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:10369:x1869977655213184:12345-192.168.204.36@tcp:101:bash.0 Request processed in 7541us (7829us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1783349823.838776:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:1.0:1783349823.841408:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.841547:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655213568 00000100:00100000:0.0:1783349823.841563:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655213568 00000100:00100000:0.0:1783349823.841645:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:0.0:1783349823.841668:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:10369:x1869977655213568:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:0.0:1783349823.842106:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.842129:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.842144:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349823.842204:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1783349823.842229:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038879d00 reply state 0000000030ffdbf4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349823.842240:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349823.842380:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10369:x1869977655213568:12345-192.168.204.36@tcp:36:bash.0 Request processed in 724us (989us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783349823.842389:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000020:00080000:0.0:1783349823.842396:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783349823.845089:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.845131:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.845139:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.845146:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.845152:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.845160:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.845180:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.845183:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349823.845189:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.845196:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349823.847212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.847263:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655213696 00000100:00100000:0.0:1783349823.847276:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655213696 00000100:00100000:0.0:1783349823.847439:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:0.0:1783349823.847453:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:10369:x1869977655213696:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349823.847492:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349823.847523:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484766c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba38 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.847684:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.847710:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 47 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.847721:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.847771:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 47 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.847787:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 47 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349823.847832:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666769408:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349823.847940:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349823.850735:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666769408:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349823.850746:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:0.0:1783349823.850788:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349823.850977:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655213824 00000100:00100000:3.0:1783349823.850986:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655213824 00010000:00010000:3.0:1783349823.851030:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 48 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349823.851077:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:3.0:1783349823.851087:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:2361:x1869977655213824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349823.851130:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349823.851140:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 48 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.851155:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 48 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.851183:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a484766b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba31 expref: 48 pid: 6605 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.851185:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666769536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783349823.851201:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:3.0:1783349823.851206:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.851215:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349823.851223:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349823.851246:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783349823.851248:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349823.851271:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.851280:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349823.851302:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:2361:x1869977655213824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 215us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349823.851312:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 41 00000004:00200000:0.0:1783349823.851351:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783349823.851357:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349823.851490:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.851548:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484766c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba38 expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.851565:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba38 expref: 46 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.851572:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.851575:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349823.851578:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7600, rc 0) 00000100:00100000:0.0:1783349823.851617:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:10369:x1869977655213696:12345-192.168.204.36@tcp:101:bash.0 Request processed in 4168us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349823.851625:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:1.0:1783349823.851680:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666769536 00000100:00100000:1.0:1783349823.851687:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666769536 00000100:00080000:2.0:1783349823.851741:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349823.851750:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783349823.851760:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666769536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349823.851836:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349823.851881:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666769536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349823.851888:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349823.852581:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666769536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349823.855858:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.857650:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655214080 00000100:00100000:0.0:1783349823.857669:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655214080 00000100:00100000:0.0:1783349823.857763:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:0.0:1783349823.857775:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:10369:x1869977655214080:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:0.0:1783349823.858155:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10369:x1869977655214080:12345-192.168.204.36@tcp:35:bash.0 Request processed in 380us (2312us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783349823.858165:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:3.0:1783349823.920770:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.920880:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655214336 00000100:00100000:2.0:1783349823.920899:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655214336 00000100:00100000:2.0:1783349823.920985:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:2.0:1783349823.920998:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10379:x1869977655214336:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349823.921035:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349823.921062:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484766d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba3f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349823.921228:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783349823.921398:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484766d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba3f expref: 49 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.921417:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:2.0:1783349823.921421:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349823.921427:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484766d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba3f expref: 49 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.921445:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96400, rc 0) 00000100:00100000:2.0:1783349823.921557:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:10379:x1869977655214336:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 561us (797us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1783349823.921566:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:2.0:1783349823.925732:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349823.925993:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655214464 00000100:00100000:1.0:1783349823.926008:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655214464 00000100:00100000:1.0:1783349823.926182:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1783349823.926203:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:10379:x1869977655214464:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:1.0:1783349823.926353:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926377:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926390:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926412:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926419:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926426:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926567:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926576:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926582:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349823.926644:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926661:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926680:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926688:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926696:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349823.926700:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926708:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926725:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349823.926728:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349823.926734:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926741:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484766e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926759:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926766:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926773:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.926778:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349823.926788:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929390:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929419:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320e0103900) 00010000:00010000:1.0:1783349823.929423:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349823.929430:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929437:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484766e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929471:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929477:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929484:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929488:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349823.929492:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929497:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929503:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:1.0:1783349823.929505:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349823.929535:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.929543:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484766ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349823.929959:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:10379:x1869977655214464:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 3751us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349823.929973:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1783349823.933294:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.933546:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655214720 00000100:00100000:2.0:1783349823.933558:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655214720 00000100:00100000:2.0:1783349823.933689:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349823.933702:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:10379:x1869977655214720:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1783349823.934179:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:10379:x1869977655214720:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 476us (906us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783349823.934203:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:3.0:1783349823.977766:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.977882:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655214976 00000100:00100000:0.0:1783349823.977895:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655214976 00000100:00100000:0.0:1783349823.977979:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:0.0:1783349823.977991:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:10382:x1869977655214976:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349823.978027:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349823.978058:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484766f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba46 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978181:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978198:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978213:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978231:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978238:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978245:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978609:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847670b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978620:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847670b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978628:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847670b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349823.978643:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783349823.978771:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978779:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978852:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978859:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.978864:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978871:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978884:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349823.978887:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349823.978892:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978899:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a484766fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978915:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978924:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978931:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978936:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.978938:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978953:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978960:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913b00) 00010000:00010000:0.0:1783349823.978962:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349823.978964:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.978970:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.979107:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484766f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba46 expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.979128:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847670b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba46 expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349823.979147:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:1.0:1783349823.979150:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349823.979153:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6200, rc 0) 00000100:00100000:1.0:1783349823.979241:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:10382:x1869977655214976:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1252us (1492us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1783349823.979251:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:3.0:1783349823.983270:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.983397:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655215104 00000100:00100000:0.0:1783349823.983412:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655215104 00000100:00100000:0.0:1783349823.983487:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:0.0:1783349823.983499:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:10382:x1869977655215104:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1783349823.983598:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983623:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983637:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983674:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983682:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983713:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983720:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349823.983725:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983733:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983762:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349823.983765:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349823.983770:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349823.983777:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349823.984170:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349823.985164:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655215232 00000100:00100000:2.0:1783349823.985177:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655215232 00000100:00100000:2.0:1783349823.985259:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:2.0:1783349823.985270:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:2360:x1869977655215232:12345-192.168.204.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783349823.985400:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10382:x1869977655215104:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 1901us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349823.985411:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00010000:00010000:2.0:1783349823.985613:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349823.985643:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847670b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba46 expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349823.985664:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:2.0:1783349823.985669:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349823.985692:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:2360:x1869977655215232:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 425us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349823.985700:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:3.0:1783349823.987562:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349823.987784:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655215488 00000100:00100000:0.0:1783349823.987833:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655215488 00000100:00100000:0.0:1783349823.988021:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:0.0:1783349823.988033:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:10382:x1869977655215488:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349823.988392:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:10382:x1869977655215488:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 360us (841us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783349823.988401:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:1.0:1783349824.092471:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.093557:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655215616 00000100:00100000:2.0:1783349824.093574:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655215616 00000100:00100000:2.0:1783349824.093753:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00100000:2.0:1783349824.093764:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655215616:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349824.094357:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655215616:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 590us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.094357:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.094384:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 264 00000100:00100000:0.0:1783349824.094592:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655215872 00000100:00100000:0.0:1783349824.094601:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655215872 00000100:00100000:0.0:1783349824.094674:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:0.0:1783349824.094689:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2359:x1869977655215872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349824.094748:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.094857:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2359:x1869977655215872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 171us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.094862:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655215744 00000100:00100000:0.0:1783349824.094870:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:3.0:1783349824.094876:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655215744 00000100:00100000:3.0:1783349824.094952:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:3.0:1783349824.094964:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2359:x1869977655215744:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:2.0:1783349824.095048:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349824.095056:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349824.095059:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2359:x1869977655215744:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.095071:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:3.0:1783349824.098141:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.098289:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655216128 00000100:00100000:1.0:1783349824.098301:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655216128 00000100:00100000:1.0:1783349824.098460:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:1.0:1783349824.098475:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:10400:x1869977655216128:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1783349824.098519:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349824.098579:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba4d expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.098711:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476727 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.098725:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.098736:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349824.098746:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783349824.098922:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba4d expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.098939:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476727 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba4d expref: 53 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.098947:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:1.0:1783349824.098950:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783349824.098952:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacac00, rc 0) 00000100:00100000:1.0:1783349824.099015:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10400:x1869977655216128:12345-192.168.204.36@tcp:101:cat.0 Request processed in 546us (889us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783349824.099022:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:0.0:1783349824.119539:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.119751:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655216256 00000100:00100000:2.0:1783349824.119768:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655216256 00000100:00100000:2.0:1783349824.120021:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:2.0:1783349824.120035:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10401:x1869977655216256:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349824.120073:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349824.120104:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba54 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.120198:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847673c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.120215:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847673c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.120230:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847673c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349824.120335:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1783349824.120339:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349824.120371:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847673c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.120405:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba54 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.120454:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847673c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba54 expref: 54 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.120465:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349824.120469:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349824.120473:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97a00, rc 0) 00000100:00100000:2.0:1783349824.120570:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10401:x1869977655216256:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 538us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.120579:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:0.0:1783349824.124563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.124688:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655216640 00000100:00100000:2.0:1783349824.124701:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655216640 00000100:00100000:2.0:1783349824.124777:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:2.0:1783349824.124790:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10401:x1869977655216640:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1783349824.126183:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10401:x1869977655216640:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1385us (1928us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1783349824.126197:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:3.0:1783349824.131595:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.132071:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655216768 00000100:00100000:0.0:1783349824.132085:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655216768 00000100:00100000:0.0:1783349824.132176:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:0.0:1783349824.132189:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10401:x1869977655216768:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:0.0:1783349824.132211:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783349824.132247:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484766cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba38 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.132288:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba4d expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.132303:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484765d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9f9 expref: 53 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.132316:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3b00) 00010000:00010000:0.0:1783349824.132347:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349824.132435:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10401:x1869977655216768:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 248us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.132462:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349824.138770:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.138896:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655216896 00000100:00100000:0.0:1783349824.138912:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655216896 00000100:00100000:0.0:1783349824.139002:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:0.0:1783349824.139014:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10401:x1869977655216896:12345-192.168.204.36@tcp:58:lfs.0 00010000:00010000:0.0:1783349824.139191:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.139213:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.139227:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349824.139982:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783349824.140202:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783349824.140289:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783349824.140468:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10401:x1869977655216896:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1448us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.140481:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:1.0:1783349824.161986:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.163315:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655217024 00000100:00100000:2.0:1783349824.163351:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655217024 00000100:00100000:2.0:1783349824.163457:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:2.0:1783349824.163494:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10403:x1869977655217024:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349824.163531:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349824.163567:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847674a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba5b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163680:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163720:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163735:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163755:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163763:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163770:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163942:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163951:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.163959:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349824.164012:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783349824.164017:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349824.164042:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164057:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164718:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164726:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164734:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164742:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.164748:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164758:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164779:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349824.164782:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.164788:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164879:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164899:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164906:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164911:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164924:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.164927:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164932:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164940:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c3886100) 00010000:00010000:2.0:1783349824.164942:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.164945:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164951:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.164997:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a4847674a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.165013:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 53 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.165021:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349824.165023:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349824.165026:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:2.0:1783349824.165363:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10403:x1869977655217024:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1877us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.165374:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00000040:00080000:1.0:1783349824.170248:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349824.170275:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349824.170348:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783349824.170358:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349824.170570:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c9036d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666769664:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349824.170725:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00010000:00010000:2.0:1783349824.175412:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349824.178067:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.178071:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c9036d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666769664:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349824.178304:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655217152 00000100:00100000:2.0:1783349824.178315:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655217152 00000100:00100000:2.0:1783349824.178406:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:2.0:1783349824.178418:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655217152:12345-192.168.204.36@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783349824.178541:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655217152:12345-192.168.204.36@tcp:900:lhsmtool_posix.0 Request processed in 124us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.178550:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:3.0:1783349824.180622:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.180968:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655217280 00000100:00100000:2.0:1783349824.180981:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655217280 00000100:00100000:2.0:1783349824.181085:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:2.0:1783349824.181096:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10407:x1869977655217280:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783349824.181138:0:6605:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783349824.181305:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10407:x1869977655217280:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 209us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.181313:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:3.0:1783349824.188081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.188700:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655217408 00000100:00100000:0.0:1783349824.188717:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655217408 00000100:00100000:0.0:1783349824.188855:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:0.0:1783349824.188869:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10407:x1869977655217408:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.189026:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.189051:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.189066:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194174:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194198:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194210:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194246:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194254:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194261:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349824.194302:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783349824.194307:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349824.194346:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194359:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194366:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194373:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194379:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349824.194383:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194389:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194405:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:1.0:1783349824.194408:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349824.194413:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194420:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476766 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194435:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194442:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194448:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194458:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349824.194461:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194467:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194475:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9320e0103900) 00010000:00010000:1.0:1783349824.194477:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349824.194480:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194485:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847676d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194500:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194506:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194511:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194516:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349824.194519:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194524:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194538:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:1.0:1783349824.194540:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349824.194543:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.194548:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a48476774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.194649:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10407:x1869977655217408:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 5778us (6577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.194662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:1.0:1783349824.199600:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.199723:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655217664 00000100:00100000:0.0:1783349824.199734:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655217664 00000100:00100000:0.0:1783349824.199962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:0.0:1783349824.199973:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10407:x1869977655217664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349824.199995:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349824.200017:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a4847677b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba62 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200117:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200132:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200143:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349824.200155:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783349824.200263:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200271:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200277:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200283:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349824.200287:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200294:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200326:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:0.0:1783349824.200329:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349824.200335:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200341:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200406:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a4847677b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba62 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200416:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:0.0:1783349824.200419:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349824.200422:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a4847677b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba62 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.200432:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7000, rc 0) 00000100:00100000:0.0:1783349824.200498:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655217664:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 527us (908us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1783349824.200506:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:3.0:1783349824.204724:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.204893:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655217792 00000100:00100000:2.0:1783349824.204909:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655217792 00000100:00100000:2.0:1783349824.204984:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:2.0:1783349824.204997:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655217792:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783349824.205053:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783349824.205200:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655217792:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 207us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.205206:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:3.0:1783349824.209652:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.210403:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655218048 00000100:00100000:2.0:1783349824.210420:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655218048 00000100:00100000:2.0:1783349824.210519:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:2.0:1783349824.210552:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655218048:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349824.210585:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349824.210590:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783349824.210632:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847673c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba54 expref: 54 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.210655:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349824.210666:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349824.210683:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476790 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba69 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349824.211551:0:6605:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783349824.212678:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.212704:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.212718:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.213053:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476790 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba69 expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.213078:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba69 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.213090:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c3886100) 00010000:00010000:2.0:1783349824.213093:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349824.213115:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96200, rc 0) 00000100:00100000:2.0:1783349824.213232:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10407:x1869977655218048:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2683us (3593us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783349824.213240:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:1.0:1783349824.218503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.218629:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655218304 00000100:00100000:2.0:1783349824.218644:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655218304 00000100:00100000:2.0:1783349824.218748:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:2.0:1783349824.218758:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10407:x1869977655218304:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349824.218874:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349824.218906:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba69 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.218927:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c3886100) 00010000:00010000:2.0:1783349824.218937:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349824.218962:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.218976:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.218985:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220384:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220409:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220422:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220534:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220544:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220551:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220557:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.220562:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220570:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220586:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349824.220589:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.220594:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220600:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484767a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220615:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220621:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220626:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220640:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.220643:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220649:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220657:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9376074a (ffff9320c3886000) 00010000:00010000:2.0:1783349824.220660:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.220662:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.220668:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484767ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9376074a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349824.220817:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655218304:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 2026us (2292us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349824.220829:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:3.0:1783349824.223068:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349824.223356:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655218432 00000100:00100000:0.0:1783349824.223371:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655218432 00000100:00100000:0.0:1783349824.223445:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:0.0:1783349824.223457:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10407:x1869977655218432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349824.223483:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349824.223514:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a484767b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba70 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.223585:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.223600:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.223614:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.223739:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a484767b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.223760:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.223771:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:0.0:1783349824.223774:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349824.223778:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6400, rc 0) 00000100:00100000:0.0:1783349824.223929:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10407:x1869977655218432:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 473us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.223937:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:0.0:1783349824.229631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.229742:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655218688 00000100:00100000:1.0:1783349824.229756:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655218688 00000100:00100000:1.0:1783349824.229904:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:1.0:1783349824.229918:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10407:x1869977655218688:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.230045:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.230065:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.230078:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349824.230705:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783349824.230719:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 211292926196ns, next at 212292923286ns, rc = 0 00000004:00010000:1.0:1783349824.230938:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd6acfe2 reply state 0000000090900183 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.230971:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349824.231231:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10407:x1869977655218688:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1312us (1608us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1783349824.231239:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 74 00010000:00010000:3.0:1783349824.235663:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.235690:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.235700:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.235708:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349824.235715:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.235737:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.235761:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:3.0:1783349824.235764:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349824.235771:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.235777:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484767c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349824.238875:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.239763:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655218816 00000100:00100000:1.0:1783349824.239780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655218816 00000100:00100000:1.0:1783349824.239895:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:1.0:1783349824.239909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10407:x1869977655218816:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.239941:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349824.239969:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba77 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.240055:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.240072:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.240098:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:1.0:1783349824.240101:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349824.240105:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349824.240192:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10407:x1869977655218816:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 287us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.240201:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:0.0:1783349824.245205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.245350:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655218944 00000100:00100000:1.0:1783349824.245492:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655218944 00000100:00100000:1.0:1783349824.245578:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349824.245588:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1869977655218944:12345-192.168.204.36@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783349824.245632:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1783349824.245680:0:6578:0:(genops.c:1406:class_connect()) connect: client ed421ea5-67f7-4096-abd5-85a5a23dfd60, cookie 0x68b4a22a484767cf 00002000:00100000:1.0:1783349824.245696:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed421ea5-67f7-4096-abd5-85a5a23dfd60/ffff9320fb53e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783349824.245713:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783349824.246628:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783349824.246675:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9320fb539800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349824.246774:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2358:x1869977655218944:12345-192.168.204.36@tcp:8:lhsmtool_posix.0 Request processed in 1185us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.246784:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:3.0:1783349824.249279:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.250360:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655219072 00000100:00100000:1.0:1783349824.250388:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655219072 00000100:00100000:1.0:1783349824.250494:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:1.0:1783349824.250507:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:0:x1869977655219072:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783349824.251100:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1783349824.333767:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1783349824.333781:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000100:00100000:3.0:1783349824.334129:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:0:x1869977655219072:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 83617us (84857us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783349824.334140:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:3.0:1783349824.340865:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.344983:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655219328 00000100:00100000:1.0:1783349824.344999:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655219328 00000100:00100000:1.0:1783349824.345181:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:1.0:1783349824.345193:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10407:x1869977655219328:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783349824.349972:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:10407:x1869977655219328:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 4769us (9166us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783349824.349995:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:0.0:1783349824.360967:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.361054:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655219584 00000100:00100000:3.0:1783349824.361183:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655219584 00000100:00100000:3.0:1783349824.361247:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:3.0:1783349824.361258:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:10407:x1869977655219584:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783349824.361384:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:10407:x1869977655219584:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 128us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.361392:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:1.0:1783349824.369184:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.369227:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655219712 00000100:00100000:1.0:1783349824.369238:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655219712 00000100:00100000:1.0:1783349824.369291:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:1.0:1783349824.369303:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:10407:x1869977655219712:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.369335:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349824.369368:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484767d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba7e expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.369448:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a484767dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.369463:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a484767dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.370356:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a484767dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349824.370404:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349824.370425:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a484767dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.370459:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484767d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba7e expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.370551:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a484767dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba7e expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.370566:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:1.0:1783349824.370569:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783349824.370573:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca800, rc 0) 00000100:00100000:1.0:1783349824.370650:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:10407:x1869977655219712:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1347us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.370659:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:1.0:1783349824.386016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.386064:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655219840 00000100:00100000:3.0:1783349824.386076:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655219840 00000100:00100000:3.0:1783349824.386135:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:3.0:1783349824.386147:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2361:x1869977655219840:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349824.386181:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349824.386207:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba85 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349824.386238:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc23f, blocks: 0x1 00010000:00010000:3.0:1783349824.386264:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=211s v=(0 0) 00010000:00010000:3.0:1783349824.386269:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349824.386280:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 6 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.386304:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 6 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.386329:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002600, rc 0) 00000100:00100000:3.0:1783349824.386398:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655219840:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 254us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.386407:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:3.0:1783349824.393574:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.393609:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220096 00000100:00100000:3.0:1783349824.393619:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220096 00000100:00100000:3.0:1783349824.393779:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:3.0:1783349824.393808:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:10407:x1869977655220096:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783349824.394257:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:10407:x1869977655220096:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 466us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.394266:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:3.0:1783349824.407082:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.407121:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220224 00000100:00100000:3.0:1783349824.407131:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220224 00000100:00100000:3.0:1783349824.407195:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:3.0:1783349824.407207:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:10407:x1869977655220224:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349824.407230:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349824.407255:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba8c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.407297:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.407307:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349824.407312:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349824.407328:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.407367:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.407383:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.407401:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec483480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6579:1869977666769792:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349824.407498:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817840 going to sleep for 11 seconds 00000001:00080000:3.0:1783349824.415834:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1783349824.415896:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1783349824.415915:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320ca1b2480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783349824.415920:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320c936a800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320ca1b2240 00000020:00080000:3.0:1783349824.415923:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320c936ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9320fab88c00 00000004:00080000:3.0:1783349824.415944:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1783349824.416122:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1783349824.416156:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666769920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783349824.416224:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783349824.416234:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1783349824.416385:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666770048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783349824.416416:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349824.416448:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666769920 00000100:00100000:3.0:1783349824.416458:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666769920 00000100:00100000:3.0:1783349824.416500:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666770048 00000100:00100000:3.0:1783349824.416503:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666770048 00000100:00100000:3.0:1783349824.416519:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783349824.416528:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1869977666769920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783349824.416558:0:6580:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1783349824.416588:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a4bc23d, atime: 0x6a4bc23e, ctime: 0x6a4bc23d, blocks: 0x1 00010000:00010000:3.0:1783349824.416597:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.416614:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=211s v=(0 0) 00010000:00010000:3.0:1783349824.416619:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349824.416625:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.416642:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.416665:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.416675:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.416690:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349824.417184:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666769920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 654us (957us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783349824.417191:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783349824.417214:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349824.417221:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666770048:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1783349824.417261:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320ec481880/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783349824.417267:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666769920:0@lo:6:osp-syn-1-0.0 00002000:00010000:3.0:1783349824.417394:0:6580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783349824.417397:0:6580:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1783349824.417400:0:6580:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783349824.417402:0:6580:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783349823 -> 1783349823 00002000:00010000:3.0:1783349824.417404:0:6580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783349824.417837:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec483480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6579:1869977666769792:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349824.417861:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.417878:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002a00, rc 0) 00000100:00100000:2.0:1783349824.417913:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:10407:x1869977655220224:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 10709us (10842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.417920:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:1.0:1783349824.417976:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.418138:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220352 00000100:00100000:2.0:1783349824.418148:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220352 00010000:00010000:2.0:1783349824.418168:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349824.418192:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:2.0:1783349824.418198:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655220352:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349824.418209:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349824.418218:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.418230:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.418252:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a484767e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba85 expref: 7 pid: 6580 timeout: 311 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.418277:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349824.418281:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349824.418289:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.418298:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.418334:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349824.418357:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1869977666770176:192.168.204.36@tcp:105: 00000100:00100000:2.0:1783349824.418397:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349824.418728:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1869977666770048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1506us (2310us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783349824.418735:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1783349824.418757:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783349824.418766:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349824.418771:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.419097:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349824.419103:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.419113:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.419126:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.419133:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed4540b1/0x68b4a22a484767f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.419149:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349824.419151:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349824.419152:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783349824.420489:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320ec482300/2, rc 0, transno 4294967302 00000100:00100000:0.0:1783349824.420502:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666770048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783349824.421589:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1869977666770176:192.168.204.36@tcp:105: 00010000:00010000:2.0:1783349824.421613:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349824.421701:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655220352:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3501us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349824.421712:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:3.0:1783349824.423405:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.423673:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220480 00000100:00100000:1.0:1783349824.423682:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220480 00002000:00100000:1.0:1783349824.423726:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9320ec483480 x1869977655220480/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:575/0 lens 504/0 e 0 to 0 dl 1783349835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349824.423739:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320ec483480 with x1869977655220480 ext(0->8) 00002000:00010000:1.0:1783349824.423746:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320ec483480 00000100:00100000:1.0:1783349824.423783:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:1.0:1783349824.423829:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655220480:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783349824.424437:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2359:x1869977655220480:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 645us (1041us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783349824.424445:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00002000:00100000:1.0:1783349824.424453:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9320ec483480 x1869977655220480/t4294967303(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:575/0 lens 504/448 e 0 to 0 dl 1783349835 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349824.424463:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320ec483480 with x1869977655220480 ext(0->8) 00002000:00010000:1.0:1783349824.424466:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320ec483480 00000100:00100000:2.0:1783349824.436457:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.436605:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220608 00000100:00100000:1.0:1783349824.436615:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220608 00000100:00100000:1.0:1783349824.436672:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:1.0:1783349824.436682:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10407:x1869977655220608:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1783349824.436820:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10407:x1869977655220608:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 138us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.436827:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:0.0:1783349824.439902:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.441400:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220736 00000100:00100000:3.0:1783349824.441581:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220736 00000100:00100000:3.0:1783349824.441645:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:3.0:1783349824.441656:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655220736:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783349824.482789:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1783349824.482844:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1783349824.483017:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655220736:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 41357us (43117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.483030:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1783349824.486266:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.486354:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655220992 00000100:00100000:1.0:1783349824.486364:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655220992 00000100:00100000:1.0:1783349824.486420:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:1.0:1783349824.486447:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10407:x1869977655220992:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.486499:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349824.486523:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a484767dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba7e expref: 13 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.486539:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:1.0:1783349824.486544:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349824.486569:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.486582:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.486591:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349824.486843:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b8fb76f reply state 00000000301c44d2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.486853:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349824.486944:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10407:x1869977655220992:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 507us (689us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783349824.486952:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:0.0:1783349824.491006:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1783349824.491244:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.491258:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.491266:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.491281:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349824.491286:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.491295:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.491323:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:1.0:1783349824.491326:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349824.491331:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.491338:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484767f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349824.496483:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655221120 00000100:00100000:2.0:1783349824.496496:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655221120 00000100:00100000:2.0:1783349824.496567:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:2.0:1783349824.496579:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655221120:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783349824.496850:0:6580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783349824.496854:0:6580:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783349822 00002000:00010000:2.0:1783349824.496856:0:6580:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783349822 00002000:00010000:2.0:1783349824.496859:0:6580:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783349823 -> 1783349822 00002000:00010000:2.0:1783349824.496861:0:6580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783349824.496939:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655221120:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 362us (5945us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783349824.496947:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:0.0:1783349824.501518:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.501839:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655221376 00000100:00100000:1.0:1783349824.501849:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655221376 00000100:00100000:1.0:1783349824.501904:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:1.0:1783349824.501915:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10407:x1869977655221376:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.501984:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.502001:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.502009:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.502042:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.502060:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 13 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.502072:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666770304:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349824.502153:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349824.506216:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666770304:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349824.506252:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.508030:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.508093:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655221504 00000100:00100000:1.0:1783349824.508104:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655221504 00010000:00010000:1.0:1783349824.508146:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.508191:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1783349824.508202:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:2362:x1869977655221504:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349824.508217:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349824.508225:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.508239:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.508265:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484767ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba70 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.508296:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:1.0:1783349824.508302:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.508324:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.508339:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.508374:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349824.508441:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2362:x1869977655221504:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 240us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.508450:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00010000:00010000:3.0:1783349824.509257:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509269:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509300:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509308:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509328:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509334:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349824.509339:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509346:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509358:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:3.0:1783349824.509362:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783349824.509366:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.509372:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476800 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.509444:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:10407:x1869977655221376:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 7529us (7930us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783349824.509466:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:3.0:1783349824.513032:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.513111:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655221632 00000100:00100000:1.0:1783349824.513123:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655221632 00000100:00100000:1.0:1783349824.513185:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:1.0:1783349824.513195:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2360:x1869977655221632:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783349824.513242:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.513264:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.513274:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349824.513278:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349824.513283:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.513344:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.513360:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 7 pid: 6579 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.513377:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6578:1869977666770432:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349824.513460:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349824.519618:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.519770:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6578:1869977666770432:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349824.519819:0:6578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.519950:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655221760 00000100:00100000:3.0:1783349824.519959:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655221760 00010000:00010000:3.0:1783349824.520010:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 8 pid: 6579 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.520059:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:3.0:1783349824.520072:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655221760:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349824.520094:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349824.520124:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 8 pid: 6579 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.520142:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 8 pid: 6579 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.520177:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a484767eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba8c expref: 8 pid: 6579 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.520191:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349824.520195:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349824.520203:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.520212:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.520256:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349824.520309:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655221760:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 238us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.520327:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 44 00010000:00010000:0.0:1783349824.520361:0:6578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520372:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520401:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520409:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520428:0:6578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520436:0:6578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349824.520440:0:6578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520449:0:6578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520462:0:6578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.520469:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000535c599/0x68b4a22a48476807 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349824.520539:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2360:x1869977655221632:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 7346us (7517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.520547:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:2.0:1783349824.525528:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.525602:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655222016 00000100:00100000:3.0:1783349824.525613:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655222016 00000100:00100000:3.0:1783349824.525668:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:3.0:1783349824.525679:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:10407:x1869977655222016:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783349824.525762:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.525779:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.525826:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.526031:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.526046:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.526059:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.526092:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.526115:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 13 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.526129:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666770560:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349824.526210:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817900 going to sleep for 11 seconds 00000100:00100000:2.0:1783349824.531393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.531529:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666770560:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349824.531554:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349824.534427:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655222144 00000100:00100000:0.0:1783349824.534443:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655222144 00010000:00010000:0.0:1783349824.534487:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349824.534531:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:0.0:1783349824.534546:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:2361:x1869977655222144:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349824.534562:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349824.534569:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.534582:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.534603:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484767c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba77 expref: 14 pid: 5786 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.534617:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:0.0:1783349824.534622:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.534631:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.534638:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.534661:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349824.534717:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2361:x1869977655222144:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 172us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.534724:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 45 00010000:00010000:3.0:1783349824.535637:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.535650:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349824.535893:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1783349824.536050:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1783349824.536162:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1783349824.536255:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666770688:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783349824.536355:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349824.536407:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666770688 00000100:00100000:0.0:1783349824.536415:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666770688 00000100:00100000:0.0:1783349824.536460:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349824.536468:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5785:x1869977666770688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783349824.536547:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5785:x1869977666770688:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349824.536554:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349824.536573:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349824.536593:0:5785:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1783349824.536598:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320ec482300, transno 4294967302 00000100:00100000:0.0:1783349824.536626:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666770688:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783349824.537228:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1783349824.537280:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666770816:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783349824.537340:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349824.537365:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79add80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349824.539614:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666770816 00000100:00100000:3.0:1783349824.539630:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666770816 00000100:00100000:3.0:1783349824.539788:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783349824.539813:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5785:x1869977666770816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783349824.540109:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1869977666770816:12345-0@lo:1000:mdt00_001.0 Request processed in 297us (2767us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783349824.540131:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349824.541870:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666770816:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783349824.541932:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.541943:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.541951:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.541958:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349824.541964:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.541973:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.541991:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c2913900) 00010000:00010000:0.0:1783349824.542000:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349824.542007:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542014:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476815 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542062:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542069:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542075:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542079:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349824.542082:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542087:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542094:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:0.0:1783349824.542096:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349824.542099:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542104:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476743 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542128:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542153:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542162:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542203:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349824.542220:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 16 pid: 5785 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349824.542238:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666770944:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349824.542764:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79add80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349824.553999:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666770944:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349824.554031:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349824.556671:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.556847:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655222272 00000100:00100000:3.0:1783349824.556858:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655222272 00010000:00010000:3.0:1783349824.556902:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 17 pid: 5785 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349824.556955:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:2.0:1783349824.556968:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:2362:x1869977655222272:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349824.556991:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349824.557002:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 17 pid: 5785 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557020:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 17 pid: 5785 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557044:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847675f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba5b expref: 17 pid: 5785 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557059:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349824.557065:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557076:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557083:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349824.557165:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349824.557236:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:2362:x1869977655222272:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 269us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349824.557246:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00010000:00010000:2.0:1783349824.557276:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557308:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557331:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557339:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557346:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557352:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.557356:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557362:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557373:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349824.557375:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.557380:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557386:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a4847681c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557399:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557405:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557417:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557423:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.557427:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557433:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557442:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349824.557445:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783349824.557448:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.557455:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a4847680e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349824.557901:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:10407:x1869977655222016:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 32222us (32380us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1783349824.557911:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00000020:00080000:1.0:1783349824.557914:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783349824.558198:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349824.558209:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349824.558498:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783349824.558505:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349824.570133:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.570231:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655222528 00000100:00100000:3.0:1783349824.570243:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655222528 00000100:00100000:3.0:1783349824.570341:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:3.0:1783349824.570422:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:10407:x1869977655222528:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783349824.571460:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783349824.571585:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1783349824.571642:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.571665:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.571692:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.571702:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.571709:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.571716:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.571813:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783349824.571923:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:10407:x1869977655222528:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1504us (1795us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783349824.571933:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000020:00080000:2.0:1783349824.571939:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349824.572079:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349824.572086:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.572094:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349824.572097:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.572105:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.572118:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349824.572121:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349824.572126:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.572132:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.572148:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349824.572154:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349824.572156:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349824.783702:0:11834:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349824.783712:0:11834:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349824.783749:0:11834:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783349824.783755:0:11834:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349824.878823:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.879385:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655222784 00000100:00100000:3.0:1783349824.879405:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655222784 00000100:00100000:3.0:1783349824.879458:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:3.0:1783349824.879467:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:10424:x1869977655222784:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349824.879492:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349824.879513:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a4847682a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba93 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.879761:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476831 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.879776:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.879786:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349824.879817:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783349824.879991:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a4847682a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba93 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.880009:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba93 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.880018:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349824.880021:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783349824.880024:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002a00, rc 0) 00000100:00100000:3.0:1783349824.880083:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10424:x1869977655222784:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 616us (1292us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783349824.880098:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:3.0:1783349824.887359:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349824.887825:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655222912 00000100:00100000:3.0:1783349824.887836:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655222912 00000100:00100000:3.0:1783349824.887890:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:3.0:1783349824.887899:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10424:x1869977655222912:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:3.0:1783349824.887978:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.887996:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888009:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888023:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888031:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888037:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888442:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888452:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888460:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349824.888511:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888524:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888531:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888537:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888543:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349824.888548:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888554:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888566:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349824.888569:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349824.888573:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888580:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847683f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888591:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888597:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888609:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888614:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349824.888617:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888624:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888632:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320cf8b3200) 00010000:00010000:3.0:1783349824.888634:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349824.888638:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888643:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888663:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888670:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888675:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888680:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349824.888682:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888697:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888706:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3400) 00010000:00010000:3.0:1783349824.888708:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349824.888711:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.888717:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847684d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.888829:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10424:x1869977655222912:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 929us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.888839:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:3.0:1783349824.937530:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349824.937948:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655223168 00000100:00100000:2.0:1783349824.937962:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655223168 00000100:00100000:2.0:1783349824.938033:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:2.0:1783349824.938044:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10427:x1869977655223168:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349824.938067:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349824.938088:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6ba9a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.938183:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.938197:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.938209:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.938225:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.938238:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.938245:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939097:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939108:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939117:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349824.939128:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783349824.939222:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939230:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939243:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939249:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.939253:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939261:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939273:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349824.939276:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.939280:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939287:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a4847685b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939300:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939562:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939572:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939577:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349824.939580:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939596:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939604:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c3886100) 00010000:00010000:2.0:1783349824.939607:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349824.939610:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939616:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939657:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939669:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349824.939676:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349824.939678:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349824.939681:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97000, rc 0) 00000100:00100000:2.0:1783349824.939755:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10427:x1869977655223168:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1713us (2234us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1783349824.939765:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:3.0:1783349824.945633:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.945735:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655223296 00000100:00100000:1.0:1783349824.945746:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655223296 00000100:00100000:3.0:1783349824.946614:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:3.0:1783349824.946632:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10427:x1869977655223296:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1783349824.946972:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.946992:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947006:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947039:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947066:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947072:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947079:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349824.947084:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947092:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947118:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349824.947121:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349824.947126:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349824.947132:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349824.947269:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10427:x1869977655223296:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 644us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349824.947278:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:3.0:1783349824.954846:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349824.954945:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655223552 00000100:00100000:1.0:1783349824.954956:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655223552 00000100:00100000:1.0:1783349824.955028:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:1.0:1783349824.955039:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10427:x1869977655223552:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349824.955284:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:10427:x1869977655223552:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 246us (445us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1783349824.955293:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:2.0:1783349825.003484:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.003670:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655223808 00000100:00100000:3.0:1783349825.003683:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655223808 00000100:00100000:3.0:1783349825.003832:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:3.0:1783349825.003847:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:9958:x1869977655223808:12345-192.168.204.36@tcp:101:bash.0 00000100:00080000:0.0:1783349825.003871:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783349825.003915:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349825.003945:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847687e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6baa1 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.004090:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.004107:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.004118:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.004161:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.004178:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 23 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.004196:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666771072:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349825.004338:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7817f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349825.010009:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f7ae3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666771072:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349825.010041:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349825.011765:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.011928:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655223936 00000100:00100000:3.0:1783349825.011939:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655223936 00010000:00010000:3.0:1783349825.011981:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 24 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.012027:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:3.0:1783349825.012036:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:2361:x1869977655223936:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349825.012074:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349825.012082:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 24 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.012097:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 24 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.012121:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba9a expref: 24 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.012139:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349825.012144:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.012153:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.012160:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.012193:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349825.012244:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.012258:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.012274:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:2361:x1869977655223936:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 237us (515us total) trans 0 rc 0/0 00000004:00200000:0.0:1783349825.012281:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1783349825.012285:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00010000:00010000:0.0:1783349825.012547:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847687e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 24 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.012573:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.012580:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:0.0:1783349825.012582:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349825.012584:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002c00, rc 0) 00000100:00100000:0.0:1783349825.012622:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:9958:x1869977655223808:12345-192.168.204.36@tcp:101:bash.0 Request processed in 8780us (9157us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783349825.012627:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:2.0:1783349825.018083:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.018318:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655224192 00000100:00100000:0.0:1783349825.018331:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655224192 00000100:00100000:0.0:1783349825.018405:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 88 00000100:00100000:0.0:1783349825.018416:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:9958:x1869977655224192:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:0.0:1783349825.018730:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.018752:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.018765:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349825.018874:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1783349825.018899:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000039fc750 reply state 0000000006aed1fe transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.018907:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783349825.018970:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1783349825.019094:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:9958:x1869977655224192:12345-192.168.204.36@tcp:36:bash.0 Request processed in 679us (1023us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1783349825.019101:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 88 00000020:00080000:0.0:1783349825.019106:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783349825.024833:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.025398:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655224320 00000100:00100000:2.0:1783349825.025410:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655224320 00000100:00100000:2.0:1783349825.025491:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:2.0:1783349825.025502:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:9958:x1869977655224320:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349825.025523:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.025529:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349825.025538:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.025546:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.025551:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847689a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6baa8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.025552:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349825.025559:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.025570:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.025587:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:1.0:1783349825.025591:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349825.025595:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.025601:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476893 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.025621:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847689a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa8 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.025635:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847689a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa8 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.025654:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349825.025657:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349825.025660:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96000, rc 0) 00000100:00100000:2.0:1783349825.025721:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:9958:x1869977655224320:12345-192.168.204.36@tcp:101:bash.0 Request processed in 221us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.025727:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:2.0:1783349825.028715:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.028875:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655224448 00000100:00100000:3.0:1783349825.028884:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655224448 00000100:00100000:3.0:1783349825.028939:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:3.0:1783349825.028948:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:9958:x1869977655224448:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349825.028982:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349825.029003:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6baaf expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349825.029031:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4bc23e, atime: 0x6a4bc23e, ctime: 0x6a4bc23e, blocks: 0xb 00010000:00010000:3.0:1783349825.029053:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=212s v=(0 0) 00010000:00010000:3.0:1783349825.029057:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349825.029066:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 7 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.029085:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 7 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.029098:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002800, rc 0) 00000100:00100000:3.0:1783349825.029175:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:9958:x1869977655224448:12345-192.168.204.36@tcp:101:bash.0 Request processed in 225us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.029183:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:3.0:1783349825.031403:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.031498:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655224576 00000100:00100000:2.0:1783349825.031508:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655224576 00002000:00010000:2.0:1783349825.031547:0:6585:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1783349825.031552:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320f7ae3800 with x1869977655224576 ext(0->18446744073709551615) 00002000:00010000:2.0:1783349825.031563:0:6585:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320f7ae3800. 00000100:00100000:2.0:1783349825.031593:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:2.0:1783349825.031600:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655224576:12345-192.168.204.36@tcp:10:bash.0 00002000:00010000:2.0:1783349825.032045:0:6585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783349825.032062:0:6585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783349822 -> 1783349824 00002000:00010000:2.0:1783349825.032065:0:6585:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783349822 -> 1783349822 00002000:00010000:2.0:1783349825.032067:0:6585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783349822 -> 1783349824 00002000:00010000:2.0:1783349825.032069:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783349825.032255:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655224576:12345-192.168.204.36@tcp:10:bash.0 Request processed in 653us (860us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783349825.032263:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1 00002000:00010000:2.0:1783349825.032267:0:6585:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1783349825.032270:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320f7ae3800 with x1869977655224576 ext(0->18446744073709551615) 00002000:00010000:2.0:1783349825.032275:0:6585:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320f7ae3800. 00000100:00100000:1.0:1783349825.085009:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.085237:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655224704 00000100:00100000:0.0:1783349825.085248:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655224704 00000100:00100000:0.0:1783349825.085317:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:0.0:1783349825.085327:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:10441:x1869977655224704:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:0.0:1783349825.085407:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085426:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085437:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085453:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085459:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085465:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085745:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085755:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085773:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349825.085852:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085864:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085870:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085877:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085883:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.085887:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085894:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085905:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349825.085908:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.085912:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085918:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085931:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085943:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085949:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085956:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.085960:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085965:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085972:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913900) 00010000:00010000:0.0:1783349825.085975:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.085977:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085983:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.085996:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.086002:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.086007:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.086011:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.086019:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.086025:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.086033:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:0.0:1783349825.086035:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.086038:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.086043:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.087496:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:10441:x1869977655224704:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 2161us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.087518:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:1.0:1783349825.120593:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.121377:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655224960 00000100:00100000:0.0:1783349825.121393:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655224960 00000100:00100000:0.0:1783349825.121470:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:0.0:1783349825.121483:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:10444:x1869977655224960:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349825.121506:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.121534:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bab6 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.121827:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.121844:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.121855:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.121871:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.121895:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.121902:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122225:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a484768d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122235:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a484768d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122243:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a484768d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.122254:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783349825.122534:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122598:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122606:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122611:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.122615:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122622:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122644:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349825.122647:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.122652:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122658:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a484768c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122673:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122679:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122684:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122689:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.122692:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122697:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122703:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913900) 00010000:00010000:0.0:1783349825.122705:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.122708:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122713:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a484768cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122772:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a484768bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bab6 expref: 30 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122785:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a484768d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bab6 expref: 29 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.122814:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:0.0:1783349825.122816:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783349825.122819:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7a00, rc 0) 00000100:00100000:0.0:1783349825.122887:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:10444:x1869977655224960:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1407us (2304us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1783349825.122897:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:3.0:1783349825.129335:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.129413:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655225088 00000100:00100000:1.0:1783349825.129424:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655225088 00000100:00100000:1.0:1783349825.129497:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:1.0:1783349825.129508:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:10444:x1869977655225088:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1783349825.129590:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.129610:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 29 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.129621:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.129664:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 29 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.129680:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 29 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.129697:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8613100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666771200:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349825.129917:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783349825.133824:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.133902:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655225344 00000100:00100000:2.0:1783349825.133915:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655225344 00000100:00100000:3.0:1783349825.133943:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8613100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666771200:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349825.133980:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349825.133991:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:2.0:1783349825.134005:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:5565:x1869977655225344:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783349825.134431:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:5565:x1869977655225344:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 426us (644us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783349825.134441:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:2.0:1783349825.139998:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.140190:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655225472 00000100:00100000:1.0:1783349825.140202:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655225472 00010000:00010000:1.0:1783349825.140252:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 31 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.140330:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:1.0:1783349825.140340:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:2361:x1869977655225472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349825.140359:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349825.140366:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 31 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.140380:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 31 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.140403:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476885 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa1 expref: 31 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.140420:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:1.0:1783349825.140426:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.140436:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.140443:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.140480:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349825.140552:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:2361:x1869977655225472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 213us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.140560:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00010000:00010000:2.0:1783349825.140678:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140688:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140725:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140734:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140750:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140758:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.140763:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140771:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140782:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349825.140784:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349825.140788:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.140841:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484768e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349825.140903:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:10444:x1869977655225088:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 11397us (11579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.140913:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:2.0:1783349825.147240:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.147339:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655225728 00000100:00100000:1.0:1783349825.147360:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655225728 00000100:00100000:1.0:1783349825.147424:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:1.0:1783349825.147433:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:10444:x1869977655225728:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349825.147735:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:10444:x1869977655225728:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 302us (505us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1783349825.147744:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00010000:00010000:2.0:1783349825.195435:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349825.225861:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.228054:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655225984 00000100:00100000:2.0:1783349825.228072:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655225984 00000100:00100000:2.0:1783349825.228143:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:2.0:1783349825.228218:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+30:10455:x1869977655225984:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1783349825.228247:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349825.228271:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484768e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6babd expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228387:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228470:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228488:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228505:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228588:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228597:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228980:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484768fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228990:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484768fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.228998:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484768fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349825.229009:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783349825.229100:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.229108:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.229120:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.229126:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.229130:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.229136:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.229149:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349825.231894:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349825.231907:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.231919:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a484768ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.231946:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.231952:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.231959:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.231964:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.231968:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.231996:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.232013:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c3886100) 00010000:00010000:2.0:1783349825.232015:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349825.232018:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.232023:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a484768f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.232101:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484768e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6babd expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.232116:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484768fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6babd expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.232123:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349825.232125:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349825.232128:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96800, rc 0) 00000100:00100000:2.0:1783349825.232231:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:10455:x1869977655225984:12345-192.168.204.36@tcp:101:cat.0 Request processed in 4078us (6379us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1783349825.232242:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:0.0:1783349825.239424:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.239537:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655226240 00000100:00100000:1.0:1783349825.239547:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655226240 00000100:00100000:1.0:1783349825.240774:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349825.240809:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:10455:x1869977655226240:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1783349825.241070:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10455:x1869977655226240:12345-192.168.204.36@tcp:35:cat.0 Request processed in 282us (1659us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1783349825.241078:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349825.260482:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.260719:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655226496 00000100:00100000:3.0:1783349825.260730:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655226496 00000100:00100000:3.0:1783349825.260815:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:3.0:1783349825.260841:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10456:x1869977655226496:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:3.0:1783349825.260906:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783349825.260935:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484768fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6babd expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.260972:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a484768d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bab6 expref: 32 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.260987:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847689a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baa8 expref: 31 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.260998:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349825.261009:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349825.261036:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261051:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261062:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261076:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261083:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261090:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261421:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261430:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.261437:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783349825.264154:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1783349825.264172:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 212326378963ns, next at 213326375253ns, rc = 0 00010000:00010000:3.0:1783349825.264265:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264283:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264296:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264317:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264324:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264331:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264405:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349825.264426:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264441:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264447:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264452:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349825.264457:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264464:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264477:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3600) 00010000:00010000:3.0:1783349825.264480:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783349825.264484:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264490:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476918 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264513:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264519:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264524:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264529:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349825.264538:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264544:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264552:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349825.264554:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349825.264557:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.264563:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847690a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349825.264573:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087d9a752 reply state 00000000dc6baaab transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.264583:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349825.265004:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:10456:x1869977655226496:12345-192.168.204.36@tcp:36:rm.0 Request processed in 4156us (4521us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1783349825.265015:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 94 00010000:00010000:1.0:1783349825.265747:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349825.265756:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.265765:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349825.265769:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.265776:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.265858:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9320cf8b3600) 00010000:00010000:1.0:1783349825.265863:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783349825.265867:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.265888:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847691f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.265913:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349825.265915:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349825.265917:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349825.269223:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.269243:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.269268:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.269274:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.269278:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.269285:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.269312:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320cf8b3700) 00010000:00010000:2.0:1783349825.269315:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349825.269320:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.269326:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476911 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.308486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.308924:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655226752 00000100:00100000:3.0:1783349825.308935:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655226752 00000100:00100000:3.0:1783349825.309001:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:3.0:1783349825.309011:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:10462:x1869977655226752:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349825.309036:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349825.309057:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476926 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bac4 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.309239:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.309260:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.309273:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.309290:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.309306:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.309313:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349825.309963:0:6605:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1783349825.310135:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310147:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310156:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310194:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310201:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310209:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310221:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349825.310226:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310234:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310246:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349825.310249:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349825.310254:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310260:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847692d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349825.310274:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000debae31b reply state 00000000e50a8d01 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.310283:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783349825.310327:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476926 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 34 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310341:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 33 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.310348:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:3.0:1783349825.310350:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349825.310352:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002400, rc 0) 00000100:00100000:3.0:1783349825.310431:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:10462:x1869977655226752:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1421us (1954us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1783349825.310447:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:0.0:1783349825.319412:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1783349825.319765:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.319779:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.319787:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.319809:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349825.319814:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.319821:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.319838:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320cf8b3d00) 00010000:00010000:1.0:1783349825.319841:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349825.319845:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.319852:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476934 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.321206:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655226880 00000100:00100000:3.0:1783349825.321220:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655226880 00000100:00100000:2.0:1783349825.321739:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:2.0:1783349825.321750:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655226880:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349825.321771:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349825.321829:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bacb expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349825.321858:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349825.321880:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=212s v=(0 0) 00010000:00010000:2.0:1783349825.321885:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349825.321893:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 8 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.321927:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 8 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.321939:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96200, rc 0) 00000100:00100000:2.0:1783349825.322013:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655226880:12345-192.168.204.36@tcp:101:bash.0 Request processed in 265us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.322020:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:3.0:1783349825.325461:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.326358:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655227008 00000100:00100000:0.0:1783349825.326369:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655227008 00000100:00100000:0.0:1783349825.326442:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:0.0:1783349825.326453:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:10462:x1869977655227008:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349825.326485:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.326510:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bad2 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.326542:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 9 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.326571:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349825.326575:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349825.326580:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 9 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.326626:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 9 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.326641:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 9 pid: 6579 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.326657:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6580:1869977666771328:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349825.326743:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349825.329376:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.329467:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655227136 00000100:00100000:1.0:1783349825.329489:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655227136 00010000:00010000:1.0:1783349825.329527:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 10 pid: 6579 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.329574:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:1.0:1783349825.329583:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2362:x1869977655227136:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349825.329599:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349825.329620:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 10 pid: 6579 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.329634:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 10 pid: 6579 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.329659:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349825.329663:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349825.329670:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 10 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.329680:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 10 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.329717:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 10 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.329731:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5770:1869977666771456:192.168.204.36@tcp:105: 00000100:00100000:1.0:1783349825.329815:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0d900 going to sleep for 11 seconds 00010000:00010000:0.0:1783349825.330115:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074973888/0x68b4a22a48476949 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bacb expref: 10 pid: 6579 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.330132:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6580:1869977666771328:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349825.330157:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 9 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.330168:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6a00, rc 0) 00000100:00100000:0.0:1783349825.330305:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:10462:x1869977655227008:12345-192.168.204.36@tcp:101:bash.0 Request processed in 3846us (4847us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.330323:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:1.0:1783349825.335101:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5770:1869977666771456:192.168.204.36@tcp:105: 00010000:00010000:1.0:1783349825.335134:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349825.335194:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655227136:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5610us (5826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.335206:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:2.0:1783349825.336714:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.336830:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655227392 00000100:00100000:0.0:1783349825.336945:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655227392 00000100:00100000:0.0:1783349825.337003:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:0.0:1783349825.337013:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:10462:x1869977655227392:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:0.0:1783349825.337724:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:10462:x1869977655227392:12345-192.168.204.36@tcp:35:bash.0 Request processed in 709us (1015us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1783349825.337733:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:0.0:1783349825.386682:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666771584:0@lo:400:kworker.0 00000100:00100000:0.0:1783349825.386770:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349825.386928:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666771968:0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.386962:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349825.387024:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349825.387032:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666771840:0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387059:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349825.387096:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666771968 00000100:00100000:3.0:1783349825.387104:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666771968 00000100:00100000:3.0:1783349825.387175:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783349825.387183:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1869977666771968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387255:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1869977666771968:12345-0@lo:400:kworker.0 Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.387262:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783349825.387314:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666771968:0@lo:400:kworker.0 00000100:00080000:3.0:1783349825.387345:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349825.387368:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666771712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349825.387413:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666771840 00000100:00100000:3.0:1783349825.387414:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666772224:0@lo:400:kworker.0 00000100:00100000:2.0:1783349825.387421:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666771840 00000100:00100000:3.0:1783349825.387441:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349825.387471:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349825.387471:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666771712 00000100:00100000:2.0:1783349825.387477:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666771712 00000100:00100000:3.0:1783349825.387479:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666772096:0@lo:400:kworker.0 00000100:00100000:2.0:1783349825.387502:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783349825.387511:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666771840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387523:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349825.387634:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666771840:12345-0@lo:400:kworker.0 Request processed in 125us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.387641:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783349825.387654:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666772096 00000100:00100000:2.0:1783349825.387657:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666772096 00000100:00100000:2.0:1783349825.387675:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349825.387681:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666771712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349825.387721:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666771712:12345-0@lo:400:kworker.0 Request processed in 39us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.387729:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783349825.387744:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1783349825.387747:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349825.387776:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666772096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387785:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666772224 00000100:00100000:3.0:1783349825.387811:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666772224 00000100:00100000:3.0:1783349825.387841:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783349825.387847:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666772224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349825.387854:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666772096:12345-0@lo:400:kworker.0 Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.387884:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666772224:12345-0@lo:400:kworker.0 Request processed in 37us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.387889:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783349825.387912:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666772096:0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387921:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666771712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387930:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666772224:0@lo:400:kworker.0 00000100:00100000:3.0:1783349825.387971:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666771840:0@lo:400:kworker.0 00000100:00100000:1.0:1783349825.388065:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666771584 00000100:00100000:1.0:1783349825.388070:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666771584 00000100:00100000:1.0:1783349825.388146:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783349825.388155:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666771584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349825.388240:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666771584:0@lo:400:kworker.0 00000100:00100000:2.0:1783349825.388261:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783349825.388291:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666771584:12345-0@lo:400:kworker.0 Request processed in 137us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.388307:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783349825.459175:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.459450:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655227520 00000100:00100000:0.0:1783349825.459461:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655227520 00000100:00100000:0.0:1783349825.459524:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 96 00000100:00100000:0.0:1783349825.459534:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:10478:x1869977655227520:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349825.459559:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.459579:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bad9 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.459641:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847695e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.459655:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847695e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.459689:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847695e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.459763:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783349825.459780:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349825.459848:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847695e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.459879:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad9 expref: 36 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.459899:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847695e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad9 expref: 35 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.459909:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349825.459912:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349825.459917:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6e00, rc 0) 00000100:00100000:0.0:1783349825.459999:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:10478:x1869977655227520:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 466us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.460007:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 96 00000100:00100000:3.0:1783349825.467568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.468247:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655227776 00000100:00100000:0.0:1783349825.468259:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655227776 00000100:00100000:0.0:1783349825.468402:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 97 00000100:00100000:0.0:1783349825.468414:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:10478:x1869977655227776:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349825.468441:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.468475:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bae0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.468627:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a4847696c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.468649:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a4847696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.468663:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a4847696c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.468676:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783349825.468844:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae0 expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.468865:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a4847696c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae0 expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.468874:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:0.0:1783349825.468877:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349825.468880:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:0.0:1783349825.468951:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:10478:x1869977655227776:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 540us (1398us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1783349825.468960:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 97 00000100:00100000:2.0:1783349825.480662:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.480717:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.480817:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228032 00000100:00100000:0.0:1783349825.480831:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228032 00000100:00100000:0.0:1783349825.480907:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 98 00000100:00100000:0.0:1783349825.480919:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:10478:x1869977655228032:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349825.480951:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.481182:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a4847697a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bae7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.481395:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476981 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.481412:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.481424:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.481440:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783349825.481568:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a4847697a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae7 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.481587:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476981 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae7 expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.481595:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:0.0:1783349825.481598:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783349825.481602:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7400, rc 0) 00000100:00100000:0.0:1783349825.481673:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:10478:x1869977655228032:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 756us (1023us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1783349825.481682:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 98 00000100:00100000:3.0:1783349825.481758:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228160 00000100:00100000:3.0:1783349825.481764:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228160 00000100:00100000:3.0:1783349825.481831:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:3.0:1783349825.481839:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:2360:x1869977655228160:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349825.481851:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349825.481868:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a4847696c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae0 expref: 39 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.481879:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:3.0:1783349825.481882:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349825.481910:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:2360:x1869977655228160:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 72us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.481917:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:3.0:1783349825.489680:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.489855:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228288 00000100:00100000:0.0:1783349825.489869:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228288 00000100:00100000:0.0:1783349825.489939:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:0.0:1783349825.489949:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655228288:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:0.0:1783349825.490161:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.490184:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 8 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.490192:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349825.490196:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349825.490200:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.490238:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 8 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.490392:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 8 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.490413:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1869977666772352:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349825.491972:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349825.496368:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1869977666772352:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349825.496406:0:6578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.499053:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.499220:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228416 00000100:00100000:1.0:1783349825.499232:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228416 00002000:00100000:1.0:1783349825.499390:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9320f7180700 x1869977655228416/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:576/0 lens 504/0 e 0 to 0 dl 1783349836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349825.499402:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320f7180700 with x1869977655228416 ext(0->8) 00010000:00010000:1.0:1783349825.499414:0:6586:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 9 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.499433:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 9 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349825.499441:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320f7180700 00000100:00100000:1.0:1783349825.499473:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:1.0:1783349825.499486:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655228416:12345-192.168.204.36@tcp:4:lfs.0 00000100:00100000:1.0:1783349825.501457:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:2361:x1869977655228416:12345-192.168.204.36@tcp:4:lfs.0 Request processed in 1961us (2400us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783349825.501473:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1 00002000:00100000:1.0:1783349825.501486:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9320f7180700 x1869977655228416/t4294967302(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:576/0 lens 504/448 e 0 to 0 dl 1783349836 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349825.501496:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320f7180700 with x1869977655228416 ext(0->8) 00010000:00010000:1.0:1783349825.501506:0:6586:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 11 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.501524:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 11 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349825.501532:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320f7180700 00000100:00100000:2.0:1783349825.504560:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.504900:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228544 00000100:00100000:1.0:1783349825.504911:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228544 00010000:00010000:1.0:1783349825.504958:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 11 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.505018:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:1.0:1783349825.505033:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:2362:x1869977655228544:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349825.505056:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783349825.505082:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783349825.505087:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783349824 00002000:00010000:1.0:1783349825.505102:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783349824 00002000:00010000:1.0:1783349825.505105:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783349824 00010000:00010000:1.0:1783349825.505128:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 11 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.505146:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 11 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.505173:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ef52f9/0x68b4a22a48476950 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad2 expref: 11 pid: 6580 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.505192:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349825.505197:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349825.505205:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.505216:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.505254:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349825.505337:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2362:x1869977655228544:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 308us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.505346:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00010000:00010000:0.0:1783349825.505605:0:6578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505627:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505653:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505662:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505669:0:6578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505676:0:6578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349825.505681:0:6578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505690:0:6578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505705:0:6578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.505714:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d18822/0x68b4a22a4847698f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.505779:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655228288:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 15831us (16111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.505788:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:2.0:1783349825.509006:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.509447:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228800 00000100:00100000:0.0:1783349825.509458:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228800 00000100:00100000:0.0:1783349825.509576:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:0.0:1783349825.509589:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:10478:x1869977655228800:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:0.0:1783349825.509681:0:5788:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476981 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae7 expref: 38 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349825.510012:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1783349825.510067:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783349825.510774:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1783349825.510859:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.510875:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.510885:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.510922:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.510939:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 42 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.510977:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5788:1869977666772480:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349825.511176:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349825.514836:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.514922:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655228928 00000100:00100000:1.0:1783349825.514933:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655228928 00000100:00100000:0.0:1783349825.515522:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5788:1869977666772480:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349825.515554:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515745:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 43 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.515781:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:1.0:1783349825.515822:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:2362:x1869977655228928:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349825.515858:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349825.515866:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 43 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515878:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 43 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515901:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847693b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bac4 expref: 43 pid: 6605 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515917:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:1.0:1783349825.515922:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515932:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515939:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.515974:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349825.516003:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.516012:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.516034:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+42:2362:x1869977655228928:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 244us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.516040:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00000001:00080000:0.0:1783349825.516958:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783349825.517358:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1783349825.518020:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666772608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349825.518086:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349825.518121:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c79add80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349825.518235:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666772608 00000100:00100000:3.0:1783349825.518243:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666772608 00000100:00100000:3.0:1783349825.518306:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349825.518316:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5788:x1869977666772608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349825.518405:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5788:x1869977666772608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.518413:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349825.518520:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666772608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783349825.519092:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1783349825.519164:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666772736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783349825.519203:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349825.519232:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349825.519686:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666772736 00000100:00100000:3.0:1783349825.519694:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666772736 00000100:00100000:3.0:1783349825.519915:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349825.519924:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5788:x1869977666772736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349825.520102:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5788:x1869977666772736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 179us (898us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783349825.520109:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349825.521890:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666772736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783349825.521984:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1783349825.522041:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.522052:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.522059:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.522064:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.522068:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.522091:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.522107:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:2.0:1783349825.522109:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783349825.522114:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.522119:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476996 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349825.522430:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783349825.523966:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1783349825.523989:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212586195905ns, next at 213586191366ns, rc = 0 00000001:00080000:2.0:1783349825.524004:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1783349825.524070:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320cf8b3000) 00010000:00010000:2.0:1783349825.524075:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783349825.524088:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476981 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bae7 expref: 46 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349825.524236:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:10478:x1869977655228800:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 14649us (15244us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1783349825.524247:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000020:00080000:2.0:1783349825.524252:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783349825.527691:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.527903:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655229056 00000100:00100000:2.0:1783349825.527915:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655229056 00000100:00100000:2.0:1783349825.527999:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:2.0:1783349825.528009:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:10478:x1869977655229056:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349825.528069:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349825.528104:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847699d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6baee expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.528183:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847699d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baee expref: 46 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.528199:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847699d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baee expref: 46 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.528221:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349825.528224:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349825.528229:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97a00, rc 0) 00000100:00100000:2.0:1783349825.528318:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:10478:x1869977655229056:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 310us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.528326:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:3.0:1783349825.533552:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.533641:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655229312 00000100:00100000:1.0:1783349825.533653:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655229312 00000100:00100000:1.0:1783349825.533715:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:1.0:1783349825.533725:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:10478:x1869977655229312:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349825.534018:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10478:x1869977655229312:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 295us (475us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1783349825.534027:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:3.0:1783349825.609063:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.609666:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655229440 00000100:00100000:1.0:1783349825.609677:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655229440 00000100:00100000:1.0:1783349825.609741:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 100 00000100:00100000:1.0:1783349825.609753:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10488:x1869977655229440:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:1.0:1783349825.609874:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.609892:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.609904:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.609921:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.609928:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.609933:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610038:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610047:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610071:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349825.610548:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610561:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610567:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610573:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610579:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349825.610584:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610591:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610602:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349825.610605:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349825.610609:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610615:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484769a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610628:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610641:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610647:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610651:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349825.610654:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610660:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610668:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320e0103f00) 00010000:00010000:1.0:1783349825.610671:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349825.610674:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610679:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484769ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610694:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610700:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610706:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.610711:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349825.611232:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.611240:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.611248:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349825.611250:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349825.611253:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.611258:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a484769b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.611370:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10488:x1869977655229440:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 1617us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.611380:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 100 00000100:00100000:3.0:1783349825.646642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.646850:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655229696 00000100:00100000:2.0:1783349825.646864:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655229696 00000100:00100000:2.0:1783349825.646944:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 101 00000100:00100000:2.0:1783349825.646956:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:10492:x1869977655229696:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349825.646983:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349825.647009:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484769b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6baf5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647116:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647135:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647168:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647193:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647201:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647207:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647389:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647398:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647405:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349825.647414:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783349825.647518:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647526:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647533:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647540:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.647550:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647559:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647572:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349825.647576:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349825.647580:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647586:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a484769c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647600:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647606:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647611:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647617:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349825.647619:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647626:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647633:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c3886700) 00010000:00010000:2.0:1783349825.647635:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349825.647643:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.647650:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.648887:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484769b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.648909:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 49 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.648919:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349825.648922:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349825.648925:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:2.0:1783349825.649039:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:10492:x1869977655229696:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2085us (2408us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1783349825.649051:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 101 00000100:00100000:2.0:1783349825.652632:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.652970:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655229824 00000100:00100000:0.0:1783349825.652980:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655229824 00000100:00100000:0.0:1783349825.653043:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 102 00000100:00100000:0.0:1783349825.653052:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:10492:x1869977655229824:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1783349825.653121:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653140:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653172:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653201:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653209:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653216:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653222:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.653227:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653235:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653249:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349825.653252:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349825.653256:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.653264:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.653395:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:10492:x1869977655229824:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 343us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.653405:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 102 00000100:00100000:3.0:1783349825.659659:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.659768:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655230080 00000100:00100000:1.0:1783349825.659779:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655230080 00000100:00100000:1.0:1783349825.659997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:1.0:1783349825.660008:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:10492:x1869977655230080:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349825.661020:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:10492:x1869977655230080:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1008us (1365us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783349825.661031:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:3.0:1783349825.731902:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.731960:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655230336 00000100:00100000:0.0:1783349825.731982:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655230336 00000100:00100000:0.0:1783349825.732064:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:0.0:1783349825.732078:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:10502:x1869977655230336:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349825.732107:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.732111:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783349825.732144:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847695e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bad9 expref: 50 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.732161:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349825.732166:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349825.732180:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bafc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.732280:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.732308:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.732316:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.732351:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.732365:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 50 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.732381:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666772864:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349825.732550:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349825.734703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.734819:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655230464 00000100:00100000:1.0:1783349825.734831:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655230464 00010000:00010000:1.0:1783349825.734872:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 51 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.734914:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:1.0:1783349825.734930:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:2362:x1869977655230464:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349825.734945:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349825.734952:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 51 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.734965:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 51 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.734988:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349825.734993:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.735003:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.735010:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.735026:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349825.735091:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:2362:x1869977655230464:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 163us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.735099:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00010000:00010000:0.0:1783349825.735308:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484769ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baf5 expref: 50 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.735327:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666772864:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349825.735354:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.735363:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.735368:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.735386:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783349825.735540:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a484769e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.735555:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.735563:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349825.735566:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349825.735569:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6200, rc 0) 00000100:00100000:0.0:1783349825.735595:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:10502:x1869977655230336:12345-192.168.204.36@tcp:101:bash.0 Request processed in 3523us (3710us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783349825.735603:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:3.0:1783349825.740571:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.740689:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655230720 00000100:00100000:0.0:1783349825.740720:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655230720 00000100:00100000:0.0:1783349825.740898:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 104 00000100:00100000:0.0:1783349825.740909:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:10502:x1869977655230720:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:0.0:1783349825.741329:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.741347:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.741359:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349825.741412:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1783349825.741439:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e84d056 reply state 00000000658934e9 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.741447:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349825.741592:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10502:x1869977655230720:12345-192.168.204.36@tcp:36:bash.0 Request processed in 683us (1032us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1783349825.741599:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 104 00000020:00080000:0.0:1783349825.741604:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783349825.744174:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.744191:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.744198:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.744222:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349825.744227:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.744235:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.744252:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349825.744255:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349825.744259:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.744265:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484769f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.745745:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.745975:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655230848 00000100:00100000:2.0:1783349825.745989:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655230848 00000100:00100000:2.0:1783349825.746055:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 105 00000100:00100000:2.0:1783349825.746066:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10502:x1869977655230848:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349825.746089:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349825.746121:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb03 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.746228:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.746253:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.746261:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.746305:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.746318:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 53 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349825.746332:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666772992:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349825.746423:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783349825.749628:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.751269:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655230976 00000100:00100000:1.0:1783349825.751283:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655230976 00010000:00010000:1.0:1783349825.751340:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 54 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349825.751387:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:1.0:1783349825.751398:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:2362:x1869977655230976:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349825.751413:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349825.751421:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 54 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.751434:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 54 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.751479:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349825.751486:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.751499:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.751506:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.751526:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349825.751592:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:2362:x1869977655230976:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 195us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.751600:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00010000:00010000:0.0:1783349825.753032:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484769ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bafc expref: 53 pid: 5786 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349825.753062:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666772992:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349825.753161:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.753173:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.753199:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.753323:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783349825.753328:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349825.753352:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.753502:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a484769ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 53 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.753519:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.753529:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349825.753531:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349825.753535:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96400, rc 0) 00000100:00100000:0.0:1783349825.753657:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10502:x1869977655230848:12345-192.168.204.36@tcp:101:bash.0 Request processed in 7591us (8411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.753666:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 105 00000100:00100000:2.0:1783349825.757934:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.758036:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655231232 00000100:00100000:0.0:1783349825.758046:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655231232 00000100:00100000:0.0:1783349825.758113:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:0.0:1783349825.758124:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:10502:x1869977655231232:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:0.0:1783349825.758574:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10502:x1869977655231232:12345-192.168.204.36@tcp:35:bash.0 Request processed in 451us (649us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1783349825.758582:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:3.0:1783349825.804950:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.805158:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655231360 00000100:00100000:1.0:1783349825.805169:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655231360 00000100:00100000:1.0:1783349825.805235:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:1.0:1783349825.805246:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:10508:x1869977655231360:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349825.805273:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349825.805305:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb0a expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.805379:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.805394:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.805405:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349825.805474:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783349825.805479:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349825.805504:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.805529:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb0a expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.805548:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb0a expref: 54 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349825.805557:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349825.805560:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349825.805563:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb400, rc 0) 00000100:00100000:1.0:1783349825.805632:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10508:x1869977655231360:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 388us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.805640:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:3.0:1783349825.809101:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.809208:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655231488 00000100:00100000:0.0:1783349825.809221:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655231488 00000100:00100000:0.0:1783349825.809308:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:0.0:1783349825.809319:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10508:x1869977655231488:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349825.809344:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349825.809378:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476a1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb11 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809460:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809479:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809493:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809510:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809517:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809523:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809643:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809651:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809690:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349825.809732:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783349825.809737:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349825.809756:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809768:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809777:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809785:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809832:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809840:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.809845:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809853:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809869:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349825.809873:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.809878:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809895:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809908:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809913:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809919:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809924:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349825.809927:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809942:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809950:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913900) 00010000:00010000:0.0:1783349825.809952:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349825.809955:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809961:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476a29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.809991:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476a1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb11 expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.810004:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb11 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.810018:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349825.810020:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349825.810023:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7000, rc 0) 00000100:00100000:0.0:1783349825.810109:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10508:x1869977655231488:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 792us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.810118:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:2.0:1783349825.813958:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.814052:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655231616 00000100:00100000:3.0:1783349825.814065:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655231616 00000100:00100000:3.0:1783349825.817771:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:3.0:1783349825.817811:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:2359:x1869977655231616:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349825.817834:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349825.817866:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb11 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.817888:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:3.0:1783349825.817893:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349825.817905:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349825.817977:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655231872 00000100:00100000:2.0:1783349825.817986:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655231872 00000100:00100000:2.0:1783349825.818034:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:3.0:1783349825.818035:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:2359:x1869977655231616:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 249us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349825.818045:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10508:x1869977655231872:12345-192.168.204.36@tcp:101:lfs.0 00000100:00100000:3.0:1783349825.818048:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00010000:00010000:2.0:1783349825.818069:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349825.818086:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb18 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.818200:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.818226:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.818235:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.818268:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.818281:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 55 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349825.818309:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c9037100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666773120:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349825.818531:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349825.827724:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349825.828393:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c9037100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666773120:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349825.828427:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.828830:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655232000 00000100:00100000:3.0:1783349825.828839:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655232000 00010000:00010000:3.0:1783349825.828880:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 56 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349825.828926:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:3.0:1783349825.828937:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:2361:x1869977655232000:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349825.828953:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349825.828960:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 56 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.828994:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 56 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.829019:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb03 expref: 56 pid: 5785 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.829036:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:3.0:1783349825.829041:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.829049:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.829058:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.829086:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349825.829150:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:2361:x1869977655232000:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 214us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.829158:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 54 00010000:00010000:2.0:1783349825.829774:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.829784:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349825.829839:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783349825.829999:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.830017:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349825.830040:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349825.830043:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349825.830046:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97200, rc 0) 00000100:00100000:2.0:1783349825.830097:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10508:x1869977655231872:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 12054us (12194us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1783349825.830105:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:2.0:1783349825.834102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.834320:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655232256 00000100:00100000:3.0:1783349825.834332:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655232256 00000100:00100000:3.0:1783349825.834413:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:3.0:1783349825.834424:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10508:x1869977655232256:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:3.0:1783349825.834441:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349825.834466:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a4847699d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baee expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.834502:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:3.0:1783349825.834508:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349825.834569:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10508:x1869977655232256:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 146us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349825.834577:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:2.0:1783349825.839330:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349825.839931:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655232384 00000100:00100000:0.0:1783349825.839943:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655232384 00000100:00100000:0.0:1783349825.840005:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 109 00000100:00100000:0.0:1783349825.840016:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10508:x1869977655232384:12345-192.168.204.36@tcp:58:lfs.0 00010000:00010000:0.0:1783349825.840108:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.840126:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.840138:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349825.840336:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783349825.840442:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10508:x1869977655232384:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 427us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.840450:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 109 00000100:00100000:0.0:1783349825.843015:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349825.843578:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655232512 00000100:00100000:3.0:1783349825.843591:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655232512 00000100:00100000:3.0:1783349825.843658:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 110 00000100:00100000:3.0:1783349825.843677:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:10508:x1869977655232512:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349825.843699:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349825.843723:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb1f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.843782:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349825.844050:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.844129:0:5784:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.844165:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.844179:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349825.844182:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349825.844186:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349825.844195:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002c00, rc 0) 00000100:00100000:0.0:1783349825.844323:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10508:x1869977655232512:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 655us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349825.844331:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 110 00000100:00100000:3.0:1783349825.898174:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349825.899967:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666773248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349825.900045:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349825.900231:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666773248 00000100:00100000:1.0:1783349825.900238:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666773248 00000100:00100000:1.0:1783349825.900304:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783349825.900313:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3292:x1869977666773248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349825.900342:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349825.900414:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3292:x1869977666773248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349825.900434:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783349825.900830:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666773248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349826.222586:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349826.603486:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349826.603497:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349826.603562:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783349826.603569:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349826.604069:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c9035180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666773376:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349826.605320:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783349826.615016:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.615051:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c9035180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666773376:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349826.615286:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655232640 00000100:00100000:1.0:1783349826.615295:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655232640 00000100:00100000:1.0:1783349826.615362:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 111 00000100:00100000:1.0:1783349826.615373:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10509:x1869977655232640:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783349826.615405:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783349826.615496:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10509:x1869977655232640:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 124us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.615505:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 111 00000100:00100000:3.0:1783349826.622926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.623534:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655232768 00000100:00100000:2.0:1783349826.623545:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655232768 00000100:00100000:2.0:1783349826.623609:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 112 00000100:00100000:2.0:1783349826.623618:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10509:x1869977655232768:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783349826.623696:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623714:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623727:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623856:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623865:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623872:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623897:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623905:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623911:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349826.623948:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783349826.623953:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349826.623967:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623978:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623985:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.623996:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624017:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.624021:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624028:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624039:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:2.0:1783349826.624042:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349826.624046:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624051:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476a5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624066:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624071:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624077:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624081:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.624083:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624088:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624101:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9320c3886700) 00010000:00010000:2.0:1783349826.624104:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349826.624106:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624112:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624125:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624130:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624136:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624141:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.624143:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624148:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624153:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349826.624154:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349826.624157:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.624161:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349826.624250:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10509:x1869977655232768:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 633us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.624259:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 112 00000100:00100000:2.0:1783349826.630068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.630177:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655233024 00000100:00100000:0.0:1783349826.630189:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655233024 00000100:00100000:0.0:1783349826.630281:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 113 00000100:00100000:0.0:1783349826.630292:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:10509:x1869977655233024:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.630318:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349826.630345:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476a6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb26 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630452:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630469:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630500:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349826.630514:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783349826.630621:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630630:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630638:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630644:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349826.630648:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630656:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630668:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349826.630671:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783349826.630676:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630683:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630721:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476a6f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb26 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630742:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:0.0:1783349826.630744:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349826.630748:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476a6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb26 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.630759:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6200, rc 0) 00000100:00100000:0.0:1783349826.630866:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10509:x1869977655233024:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 576us (808us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1783349826.630874:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 113 00000100:00100000:0.0:1783349826.635322:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.635426:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655233152 00000100:00100000:2.0:1783349826.635446:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655233152 00000100:00100000:2.0:1783349826.635505:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:2.0:1783349826.635514:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10509:x1869977655233152:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783349826.635557:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783349826.635761:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10509:x1869977655233152:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 246us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.635769:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 114 00000100:00100000:3.0:1783349826.639975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.640535:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655233408 00000100:00100000:2.0:1783349826.640549:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655233408 00000100:00100000:2.0:1783349826.640619:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 115 00000100:00100000:2.0:1783349826.640629:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10509:x1869977655233408:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349826.640650:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349826.640653:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783349826.640680:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb0a expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.640700:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349826.640705:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349826.640718:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb2d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349826.641283:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783349826.642212:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.642231:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.642242:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.644141:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476a84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb2d expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.644167:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb2d expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.644176:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320c3886700) 00010000:00010000:2.0:1783349826.644178:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349826.644182:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97600, rc 0) 00000100:00100000:2.0:1783349826.644316:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10509:x1869977655233408:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3686us (4356us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1783349826.644326:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 115 00000100:00100000:3.0:1783349826.653388:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.653560:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655233664 00000100:00100000:0.0:1783349826.653575:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655233664 00000100:00100000:0.0:1783349826.653694:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 116 00000100:00100000:0.0:1783349826.653705:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10509:x1869977655233664:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.653769:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349826.653853:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb2d expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.653878:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320c3886700) 00010000:00010000:0.0:1783349826.653889:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349826.653910:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.653924:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.653963:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.653983:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.653991:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.653999:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654094:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654102:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654109:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654115:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349826.654119:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654126:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654136:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349826.654139:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349826.654143:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654157:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476a99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654169:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654174:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654179:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654184:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349826.654186:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654192:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654199:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4dd9065a (ffff9320c2913900) 00010000:00010000:0.0:1783349826.654201:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349826.654203:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.654209:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476aa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4dd9065a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.654296:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10509:x1869977655233664:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 593us (925us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349826.654303:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 116 00000100:00100000:3.0:1783349826.658015:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.658519:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655233792 00000100:00100000:1.0:1783349826.658529:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655233792 00000100:00100000:1.0:1783349826.658585:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 117 00000100:00100000:1.0:1783349826.658594:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:10509:x1869977655233792:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349826.658614:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349826.658635:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476aa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb34 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.658667:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.658678:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.658688:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.659553:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.659591:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.659599:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:1.0:1783349826.659602:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349826.659605:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349826.659671:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10509:x1869977655233792:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1077us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.659678:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 117 00000100:00100000:3.0:1783349826.663700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.663770:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655234048 00000100:00100000:2.0:1783349826.663782:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655234048 00000100:00100000:2.0:1783349826.663923:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 118 00000100:00100000:2.0:1783349826.663933:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:10509:x1869977655234048:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349826.664020:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.664048:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.664061:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349826.664443:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1783349826.664454:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213726661271ns, next at 214726659116ns, rc = 0 00000004:00010000:2.0:1783349826.664539:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b1eecde reply state 00000000a86ffae3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349826.664549:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349826.665258:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:10509:x1869977655234048:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1196us (1438us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783349826.665278:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 118 00010000:00010000:1.0:1783349826.668574:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.668593:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.668602:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.668608:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349826.668613:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.668621:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.668640:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:1.0:1783349826.668644:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783349826.668649:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.668670:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ab5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.669279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.669413:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655234176 00000100:00100000:2.0:1783349826.669424:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655234176 00000100:00100000:2.0:1783349826.669583:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 119 00000100:00100000:2.0:1783349826.669594:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:10509:x1869977655234176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349826.669620:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349826.669637:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb3b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.669702:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.669716:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.669752:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:2.0:1783349826.669754:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349826.669758:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349826.669869:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:10509:x1869977655234176:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 277us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.669875:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 119 00000100:00100000:3.0:1783349826.673170:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.673388:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655234304 00000100:00100000:0.0:1783349826.673400:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655234304 00000100:00100000:0.0:1783349826.673516:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:0.0:1783349826.673529:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655234304:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783349826.673885:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2362:x1869977655234304:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 359us (725us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783349826.673893:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00080000:3.0:1783349826.674473:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349826.678257:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.678490:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655234560 00000100:00100000:1.0:1783349826.678500:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655234560 00000100:00100000:1.0:1783349826.678598:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:1.0:1783349826.678610:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:10509:x1869977655234560:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783349826.678915:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:10509:x1869977655234560:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 306us (667us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1783349826.678923:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1783349826.681852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.682164:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655234816 00000100:00100000:0.0:1783349826.682176:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655234816 00000100:00100000:0.0:1783349826.682247:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:0.0:1783349826.682259:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:10509:x1869977655234816:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783349826.682721:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:10509:x1869977655234816:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 462us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.682729:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:3.0:1783349826.684991:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.685150:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655234944 00000100:00100000:1.0:1783349826.685161:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655234944 00000100:00100000:2.0:1783349826.685510:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 121 00000100:00100000:2.0:1783349826.685523:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:10509:x1869977655234944:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349826.685544:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349826.685564:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476ac3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb42 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.685636:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.685650:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.685661:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349826.685697:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349826.685715:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.685741:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476ac3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb42 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.685773:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb42 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.685782:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:2.0:1783349826.685785:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783349826.685788:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:2.0:1783349826.686062:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:10509:x1869977655234944:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 542us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.686069:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 121 00000100:00100000:2.0:1783349826.689202:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.689473:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235072 00000100:00100000:0.0:1783349826.689485:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235072 00000100:00100000:0.0:1783349826.689594:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:0.0:1783349826.689605:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2362:x1869977655235072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.689624:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349826.689644:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb49 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349826.689668:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc241, blocks: 0x1 00010000:00010000:0.0:1783349826.689686:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=213s v=(0 0) 00010000:00010000:0.0:1783349826.689692:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349826.689713:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 10 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.689732:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 10 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.689744:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7200, rc 0) 00000100:00100000:0.0:1783349826.689829:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2362:x1869977655235072:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 226us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.689835:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:0.0:1783349826.691881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.691958:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235328 00000100:00100000:2.0:1783349826.691966:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235328 00000100:00100000:2.0:1783349826.692014:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 122 00000100:00100000:2.0:1783349826.692025:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:10509:x1869977655235328:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783349826.692156:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:10509:x1869977655235328:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.692164:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 122 00000100:00100000:2.0:1783349826.694632:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.694862:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235456 00000100:00100000:0.0:1783349826.694875:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235456 00000100:00100000:0.0:1783349826.694933:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:0.0:1783349826.694945:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:10509:x1869977655235456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.694972:0:7807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349826.694999:0:7807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb50 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.695049:0:7807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 11 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.695061:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349826.695067:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349826.695074:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 11 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.695141:0:7807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 11 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.695156:0:7807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 11 pid: 6579 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.695175:0:7807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7807:1869977666773504:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349826.695322:0:7807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1783349826.700545:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.700608:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235584 00000100:00100000:1.0:1783349826.700633:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235584 00010000:00010000:1.0:1783349826.700685:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 12 pid: 6579 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349826.700735:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:1.0:1783349826.700745:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:2362:x1869977655235584:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349826.700764:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349826.700821:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 12 pid: 6579 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.700833:0:7807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7807:1869977666773504:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349826.700844:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 12 pid: 6579 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.700936:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d18822/0x68b4a22a48476ad1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb49 expref: 12 pid: 6579 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.700941:0:7807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 12 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.700960:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349826.700965:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349826.700973:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 11 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.700984:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 11 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.701011:0:7807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7400, rc 0) 00010000:00010000:1.0:1783349826.701035:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 11 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349826.701050:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5771:1869977666773632:192.168.204.36@tcp:105: 00000100:00100000:0.0:1783349826.701129:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:10509:x1869977655235456:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 6186us (6515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.701135:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:1.0:1783349826.701152:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349826.705586:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.705605:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5771:1869977666773632:192.168.204.36@tcp:105: 00010000:00010000:1.0:1783349826.705633:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349826.705694:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2362:x1869977655235584:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4950us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.705705:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:3.0:1783349826.706091:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235712 00000100:00100000:3.0:1783349826.706097:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235712 00002000:00100000:3.0:1783349826.706137:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9320c4fc0e00 x1869977655235712/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:577/0 lens 504/0 e 0 to 0 dl 1783349837 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349826.706144:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320c4fc0e00 with x1869977655235712 ext(0->12) 00002000:00010000:3.0:1783349826.706148:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320c4fc0e00 00000100:00100000:3.0:1783349826.706173:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:3.0:1783349826.706187:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2361:x1869977655235712:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783349826.706695:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:2361:x1869977655235712:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 511us (1116us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783349826.706703:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00002000:00100000:3.0:1783349826.706710:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9320c4fc0e00 x1869977655235712/t4294967308(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:577/0 lens 504/448 e 0 to 0 dl 1783349837 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349826.706718:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320c4fc0e00 with x1869977655235712 ext(0->12) 00002000:00010000:3.0:1783349826.706722:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320c4fc0e00 00000100:00100000:2.0:1783349826.709074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.709176:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235840 00000100:00100000:1.0:1783349826.709186:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235840 00000100:00100000:1.0:1783349826.709290:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 123 00000100:00100000:1.0:1783349826.709382:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:10509:x1869977655235840:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1783349826.736661:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:10509:x1869977655235840:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 27341us (27582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349826.736692:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 123 00000001:00080000:3.0:1783349826.736744:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:3.0:1783349826.736832:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320c79ad180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1783349826.736837:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb304100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320c79ad300 00000020:00080000:3.0:1783349826.736840:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb304b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9320faad2000 00000001:00080000:3.0:1783349826.736851:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1783349826.737328:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000004:00080000:3.0:1783349826.737347:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1783349826.737417:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1783349826.737442:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320e408f900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1783349826.737446:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb4e0400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320e408f0c0 00000020:00080000:3.0:1783349826.737449:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb4e0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931fc4de9000 00000004:00080000:3.0:1783349826.737470:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1783349826.737605:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:0.0:1783349826.737605:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00000100:00100000:2.0:1783349826.737623:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb46bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666773760:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1783349826.737625:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783349826.737690:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.737838:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666773888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783349826.737878:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.737898:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349826.737904:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666774016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783349826.737924:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.737952:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666773760 00000100:00100000:0.0:1783349826.737952:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666773888 00000100:00100000:2.0:1783349826.737959:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666773760 00000100:00100000:0.0:1783349826.737959:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666773888 00000020:00080000:3.0:1783349826.738083:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1783349826.738086:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666774016 00000100:00100000:0.0:1783349826.738090:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666774016 00000100:00080000:3.0:1783349826.738104:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349826.738153:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349826.738164:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1869977666773888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783349826.738194:0:6580:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:1.0:1783349826.738195:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783349826.738204:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3291:x1869977666773760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783349826.738216:0:6579:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1783349826.738233:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349826.738238:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4bc240, atime: 0x6a4bc240, ctime: 0x6a4bc240, blocks: 0x1 00010000:00010000:1.0:1783349826.738244:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.738251:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=213s v=(0 0) 00010000:00010000:2.0:1783349826.738254:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.738255:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349826.738261:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.738262:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783349826.738265:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349826.738278:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.738286:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.738295:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.738303:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.738304:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.738319:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 11 pid: 6580 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.738330:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783349826.738333:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb469180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1869977666774144:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349826.738400:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408f300 going to sleep for 11 seconds 00010000:00010000:3.0:1783349826.738496:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349826.738503:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.738512:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349826.738516:0:7481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.738526:0:7481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.738556:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.738563:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7dc7943/0x68b4a22a48476ae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.738595:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349826.738597:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349826.738599:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349826.739384:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.739475:0:6578:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783349826.739484:0:6578:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783349826.739646:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3291:x1869977666773760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1442us (1955us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783349826.739655:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783349826.739679:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655235968 00000100:00100000:1.0:1783349826.739685:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655235968 00000100:00100000:1.0:1783349826.739770:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349826.739779:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1869977666774016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783349826.739958:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783349826.739962:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783349825 00002000:00010000:1.0:1783349826.739965:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783349826.739967:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783349825 -> 1783349825 00002000:00010000:1.0:1783349826.739970:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783349826.739999:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1869977666774016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (2074us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783349826.740004:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783349826.740018:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1783349826.740024:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:2362:x1869977655235968:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1783349826.740191:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320fb46bb80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1783349826.740198:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb46bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666773760:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783349826.740450:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320c8612d80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1783349826.740459:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666774016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783349826.745263:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349826.745471:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655236096 00000100:00100000:3.0:1783349826.745484:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655236096 00010000:00010000:3.0:1783349826.745716:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 13 pid: 6580 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.745755:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:3.0:1783349826.745765:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2362:x1869977655236096:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349826.745782:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349826.745788:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 13 pid: 6580 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.745835:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 13 pid: 6580 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.745880:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349826.745886:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349826.745893:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.745905:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.745926:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349826.745983:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2362:x1869977655236096:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 219us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349826.745993:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00010000:00010000:2.0:1783349826.747224:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a484768a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6baaf expref: 12 pid: 6580 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349826.747247:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb469180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1869977666774144:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349826.747340:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.747355:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.747363:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.747382:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.747390:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.747409:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783349826.748241:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3293:x1869977666773888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10075us (10357us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783349826.748259:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1783349826.748405:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320c8610000/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783349826.748415:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666773888:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783349826.748570:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349826.748578:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.748588:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349826.748593:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.748627:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.748647:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.748680:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a48476adf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.748703:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349826.748705:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349826.748707:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783349826.779350:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1783349826.779379:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1783349826.779390:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1783349826.779629:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655235968:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 39593us (40238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.779645:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:3.0:1783349826.787138:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.787234:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655236352 00000100:00100000:0.0:1783349826.787246:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655236352 00000100:00100000:0.0:1783349826.787323:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 124 00000100:00100000:0.0:1783349826.787336:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:10509:x1869977655236352:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.787399:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349826.787427:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb42 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.787448:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:0.0:1783349826.787454:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349826.787502:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.787583:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.787596:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349826.787969:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7ae5375 reply state 000000002acbc9b2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.787980:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349826.788103:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:10509:x1869977655236352:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 769us (987us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1783349826.788112:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 124 00010000:00010000:1.0:1783349826.790109:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.790126:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.790134:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.790141:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349826.790146:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.790154:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.790184:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:1.0:1783349826.790187:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349826.790192:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.790198:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476aed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.793043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.793157:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655236480 00000100:00100000:2.0:1783349826.793178:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655236480 00000100:00100000:2.0:1783349826.793294:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:2.0:1783349826.793306:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655236480:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783349826.793564:0:7807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1783349826.793569:0:7807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783349825 -> 1783349824 00002000:00010000:2.0:1783349826.793571:0:7807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783349824 00002000:00010000:2.0:1783349826.793574:0:7807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783349825 -> 1783349824 00002000:00010000:2.0:1783349826.793576:0:7807:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783349826.793653:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655236480:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 348us (630us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783349826.793660:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:2.0:1783349826.797657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.799677:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655236736 00000100:00100000:0.0:1783349826.799695:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655236736 00000100:00100000:0.0:1783349826.799781:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:0.0:1783349826.799832:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:10509:x1869977655236736:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.799911:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.799928:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.799938:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.799979:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.799993:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 15 pid: 5785 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.800008:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666774272:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349826.800114:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349826.804609:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.804913:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666774272:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349826.804951:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349826.804974:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655236864 00000100:00100000:1.0:1783349826.804984:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655236864 00010000:00010000:1.0:1783349826.805035:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 16 pid: 5785 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349826.805079:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:1.0:1783349826.805088:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:2361:x1869977655236864:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349826.805105:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349826.805112:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 16 pid: 5785 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.805123:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 16 pid: 5785 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.805144:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476aae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb34 expref: 16 pid: 5785 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.805161:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:1.0:1783349826.805165:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.805200:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.805207:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349826.805235:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349826.805312:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:2361:x1869977655236864:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 224us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.805320:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00010000:00010000:0.0:1783349826.805575:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805583:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805623:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805630:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805636:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805642:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349826.805646:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805653:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805662:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:0.0:1783349826.805665:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783349826.805677:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.805684:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476af4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.805737:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10509:x1869977655236736:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 5947us (8093us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783349826.805746:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 125 00000100:00100000:3.0:1783349826.810320:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.810408:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655236992 00000100:00100000:0.0:1783349826.810425:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655236992 00000100:00100000:0.0:1783349826.812023:0:11848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:0.0:1783349826.812066:0:11848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f71b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655236992:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.812134:0:11848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.812163:0:11848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.812173:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349826.812179:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349826.812185:0:11848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.812222:0:11848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.812236:0:11848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 7 pid: 7807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.812251:0:11848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11848:1869977666774400:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349826.812388:0:11848:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349826.820688:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349826.821018:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655237120 00000100:00100000:3.0:1783349826.821028:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655237120 00010000:00010000:3.0:1783349826.821072:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 8 pid: 7807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.821115:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:3.0:1783349826.821125:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655237120:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349826.821150:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349826.821172:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 8 pid: 7807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.821186:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 8 pid: 7807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.821232:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349826.821237:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349826.821248:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.821258:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.821287:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349826.821355:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655237120:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 230us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349826.821363:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00010000:00010000:0.0:1783349826.821433:0:11848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052b70c05/0x68b4a22a48476ad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb50 expref: 7 pid: 7807 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.821453:0:11848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11848:1869977666774400:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349826.821483:0:11848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821504:0:11848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821511:0:11848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821542:0:11848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821550:0:11848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821556:0:11848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821561:0:11848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349826.821576:0:11848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821587:0:11848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821601:0:11848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.821622:0:11848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e7729a/0x68b4a22a48476afb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.821878:0:11848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f71b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655236992:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 9821us (11575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.821886:0:11848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:2.0:1783349826.825198:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.825529:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655237376 00000100:00100000:0.0:1783349826.825550:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655237376 00000100:00100000:0.0:1783349826.825686:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 126 00000100:00100000:0.0:1783349826.825697:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10509:x1869977655237376:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783349826.825783:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.825837:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.825851:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.826062:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.826074:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.826082:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.826147:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.826162:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 15 pid: 5786 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.826177:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666774528:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349826.826259:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349826.831031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349826.831365:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655237504 00000100:00100000:3.0:1783349826.831383:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655237504 00010000:00010000:3.0:1783349826.831451:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 16 pid: 5786 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.831509:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:3.0:1783349826.831521:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:2361:x1869977655237504:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349826.831544:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349826.831553:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 16 pid: 5786 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.831569:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 16 pid: 5786 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.831625:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:3.0:1783349826.831632:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.831643:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.831651:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.831675:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349826.831759:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:2361:x1869977655237504:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 239us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349826.831769:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00010000:00010000:0.0:1783349826.831989:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb3b expref: 15 pid: 5786 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.832018:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666774528:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349826.832057:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.832069:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.832075:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349826.832855:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1783349826.833047:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1783349826.833097:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1783349826.833203:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1869977666774656:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783349826.833287:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349826.833543:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0d480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349826.833782:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666774656 00000100:00100000:3.0:1783349826.833896:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666774656 00000100:00100000:3.0:1783349826.834000:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349826.834012:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6605:x1869977666774656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783349826.834135:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6605:x1869977666774656:12345-0@lo:1000:mdt00_003.0 Request processed in 125us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349826.834146:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783349826.834227:0:6605:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1783349826.834233:0:6605:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1783349826.834257:0:6605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320c8612d80, transno 4294967309 00000100:00100000:2.0:1783349826.834287:0:6605:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9320c8610000 x1869977666773888/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783349842 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349826.834301:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1869977666774656:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1783349826.835160:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1783349826.835234:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1869977666774784:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783349826.835300:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349826.835584:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349826.835739:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666774784 00000100:00100000:0.0:1783349826.835749:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666774784 00000100:00100000:0.0:1783349826.835826:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349826.835839:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6605:x1869977666774784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783349826.836159:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6605:x1869977666774784:12345-0@lo:1000:mdt00_003.0 Request processed in 322us (858us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783349826.836166:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349826.836295:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb46ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6605:1869977666774784:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1783349826.836406:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836416:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836423:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836430:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.836435:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836443:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836460:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:2.0:1783349826.836463:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349826.836467:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836474:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836504:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836523:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836530:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836535:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.836538:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836545:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836554:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349826.836557:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349826.836564:0:6605:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836717:0:6605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836726:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.836757:0:6605:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349826.836772:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb468700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666774912:192.168.204.36@tcp:105: 00000100:00100000:2.0:1783349826.837197:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e408fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349826.840550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349826.840847:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655237632 00000100:00100000:3.0:1783349826.840863:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655237632 00000100:00100000:3.0:1783349826.840950:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:3.0:1783349826.840961:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10508:x1869977655237632:12345-192.168.204.36@tcp:49:lfs.0 00000100:00100000:0.0:1783349826.840997:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb468700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666774912:192.168.204.36@tcp:105: 00010000:00010000:0.0:1783349826.841025:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841036:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476a4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841074:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841089:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841100:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.841109:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10508:x1869977655237632:12345-192.168.204.36@tcp:49:lfs.0 Request processed in 148us (568us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349826.841113:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841121:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841129:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349826.841137:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 31 00010000:00010000:0.0:1783349826.841150:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349826.841154:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841162:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841175:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349826.841178:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349826.841182:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841188:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841199:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841205:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841210:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841215:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349826.841218:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841224:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841245:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349826.841248:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349826.841251:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.841256:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.842149:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:10509:x1869977655237376:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 16448us (16956us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1783349826.842160:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 126 00000020:00080000:0.0:1783349826.842165:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783349826.843471:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349826.843480:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349826.844404:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783349826.844420:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349826.845925:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349826.847520:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.847550:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655237888 00000100:00100000:1.0:1783349826.847566:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655237888 00000100:00100000:3.0:1783349826.847659:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655238144 00000100:00100000:3.0:1783349826.847663:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655238144 00000100:00100000:3.0:1783349826.847706:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:3.0:1783349826.847722:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:10509:x1869977655238144:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783349826.848695:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783349826.848963:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1783349826.849033:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.849051:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.849063:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.849073:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.849079:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.849085:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349826.849148:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349826.849281:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10509:x1869977655238144:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1552us (1759us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1783349826.849299:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 32 00000020:00080000:3.0:1783349826.849305:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783349826.849896:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 127 00000100:00100000:1.0:1783349826.849916:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:10508:x1869977655237888:12345-192.168.204.36@tcp:58:lfs.0 00000040:00080000:1.0:1783349826.851029:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:2.0:1783349826.851146:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349826.851155:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.851165:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349826.851168:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.851178:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.851195:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9320cf8b3400) 00010000:00010000:2.0:1783349826.851198:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783349826.851203:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349826.851280:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:10508:x1869977655237888:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1359us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349826.851292:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 127 00010000:00010000:2.0:1783349826.851984:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476b17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.852018:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349826.852020:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349826.852021:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349826.879660:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.879766:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655238272 00000100:00100000:0.0:1783349826.879783:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655238272 00000100:00100000:0.0:1783349826.879896:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 128 00000100:00100000:0.0:1783349826.879907:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:10511:x1869977655238272:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349826.879935:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349826.879956:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb57 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880018:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880032:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880045:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880080:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880087:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880094:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880651:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880664:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880672:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880705:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 21 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.880715:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 21 pid: 6605 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.880726:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5784:1869977666775040:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349826.880936:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349826.883562:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5784:1869977666775040:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349826.883596:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349826.884686:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349826.885382:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655238528 00000100:00100000:1.0:1783349826.885393:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655238528 00000100:00100000:1.0:1783349826.885456:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:1.0:1783349826.885467:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:5565:x1869977655238528:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783349826.885879:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:5565:x1869977655238528:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 413us (1198us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1783349826.885887:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:3.0:1783349826.889922:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349826.890608:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655238656 00000100:00100000:0.0:1783349826.890620:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655238656 00010000:00010000:0.0:1783349826.890665:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 23 pid: 6605 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349826.890709:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:0.0:1783349826.890719:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:2362:x1869977655238656:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349826.890735:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349826.890752:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 23 pid: 6605 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.890769:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 23 pid: 6605 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.890838:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476a3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb18 expref: 23 pid: 6605 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.890855:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349826.890964:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.890976:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.890984:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349826.891021:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349826.891094:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:2362:x1869977655238656:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 376us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349826.891103:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00010000:00010000:2.0:1783349826.891475:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891485:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349826.891594:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783349826.891600:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349826.891624:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891637:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891649:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891657:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891663:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891668:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.891672:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891679:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891690:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349826.891693:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349826.891698:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891715:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891726:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891732:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891738:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891743:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349826.891747:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891751:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891759:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9320c2913900) 00010000:00010000:2.0:1783349826.891761:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349826.891764:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891770:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7e00/0x68b4a22a48476b2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891847:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb57 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891861:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb57 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349826.891874:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349826.891877:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349826.891879:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7400, rc 0) 00000100:00100000:2.0:1783349826.891927:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10511:x1869977655238272:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 12022us (12286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349826.891934:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 128 00010000:00010000:3.0:1783349827.243296:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349827.446891:0:11887:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349827.446967:0:11887:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349827.447019:0:11887:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783349827.447026:0:11887:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783349827.882059:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349827.882068:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349827.882102:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783349827.882113:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349827.882270:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb469c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666775168:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349827.882432:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349827.886960:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349827.887064:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655238784 00000100:00100000:0.0:1783349827.887076:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655238784 00000100:00100000:0.0:1783349827.887149:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 129 00000100:00100000:0.0:1783349827.887162:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:10523:x1869977655238784:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783349827.887199:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783349827.887332:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:10523:x1869977655238784:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 173us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349827.887340:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 129 00000100:00080000:3.0:1783349827.887529:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349827.887977:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb469c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666775168:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783349827.892566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349827.892664:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655239040 00000100:00100000:2.0:1783349827.892676:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655239040 00000100:00100000:2.0:1783349827.892753:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 130 00000100:00100000:2.0:1783349827.892764:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:10523:x1869977655239040:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349827.892787:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349827.892841:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476b3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb5e expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349827.893134:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349827.893151:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349827.893163:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349827.893175:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783349827.893345:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476b3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb5e expref: 24 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349827.894082:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb5e expref: 23 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349827.894092:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349827.894095:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349827.894099:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349827.894189:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:10523:x1869977655239040:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1415us (1621us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1783349827.894198:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 130 00000100:00100000:1.0:1783349827.901700:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349827.901752:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349827.901863:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655239424 00000100:00100000:0.0:1783349827.901873:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655239424 00000100:00100000:0.0:1783349827.901934:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:0.0:1783349827.901943:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:10523:x1869977655239424:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783349827.902029:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902049:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902061:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902372:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902381:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902405:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902411:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349827.902416:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902424:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902436:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349827.902439:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349827.902444:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349827.902450:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48476b4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349827.902682:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:10523:x1869977655239424:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 738us (926us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1783349827.902691:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 131 00000100:00100000:2.0:1783349827.903153:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655239168 00000100:00100000:2.0:1783349827.903161:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655239168 00000100:00100000:2.0:1783349827.903226:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:2.0:1783349827.903235:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:2360:x1869977655239168:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349827.903260:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349827.903284:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb5e expref: 24 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349827.903298:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:2.0:1783349827.903301:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349827.903328:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:2360:x1869977655239168:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 95us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349827.903335:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000040:00080000:3.0:1783349827.904486:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349827.904493:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349827.905047:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783349827.905057:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349827.909628:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349827.909726:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655239680 00000100:00100000:3.0:1783349827.909738:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655239680 00000100:00100000:3.0:1783349827.909912:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:3.0:1783349827.909925:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:10523:x1869977655239680:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783349827.910232:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:10523:x1869977655239680:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 309us (622us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1783349827.910240:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00000001:00080000:0.0:1783349827.986036:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1783349827.986054:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1783349828.266131:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349828.971090:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783349828.971120:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666775296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349828.971198:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349828.971273:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666775296 00000100:00100000:0.0:1783349828.971281:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666775296 00000100:00100000:0.0:1783349828.971342:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783349828.971358:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1869977666775296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349828.971395:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349828.971440:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1869977666775296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349828.971447:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1783349828.971466:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349828.971501:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666775296:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783349829.068358:0:11939:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349829.068368:0:11939:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349829.068434:0:11939:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783349829.068441:0:11939:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349829.192089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349829.192170:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655239936 00000100:00100000:3.0:1783349829.192180:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655239936 00000100:00100000:3.0:1783349829.192295:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 132 00000100:00100000:3.0:1783349829.192306:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:10543:x1869977655239936:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349829.192330:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349829.192352:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476b56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb65 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349829.192456:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476b5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349829.192476:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476b5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349829.192489:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476b5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349829.192500:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783349829.192696:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb65 expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349829.192713:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476b5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb65 expref: 26 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349829.192721:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:3.0:1783349829.192724:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783349829.192727:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002800, rc 0) 00000100:00100000:3.0:1783349829.192782:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:10543:x1869977655239936:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 478us (702us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1783349829.192814:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 132 00000100:00080000:1.0:1783349829.193326:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349829.201581:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349829.201615:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240064 00000100:00100000:0.0:1783349829.201624:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240064 00000100:00100000:0.0:1783349829.201679:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 133 00000100:00100000:0.0:1783349829.201688:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:10543:x1869977655240064:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:0.0:1783349829.201755:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201772:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201784:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201827:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201835:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201842:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201862:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349829.201867:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201875:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201888:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:0.0:1783349829.201891:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349829.201896:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.201903:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7a00/0x68b4a22a48476b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349829.201979:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:10543:x1869977655240064:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 291us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349829.201988:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 133 00000100:00100000:3.0:1783349829.211376:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349829.211455:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349829.211487:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349829.211522:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349829.211583:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240576 00000100:00100000:1.0:1783349829.211594:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240576 00000100:00100000:1.0:1783349829.211656:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:1.0:1783349829.211665:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655240576:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349829.211739:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655240576:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349829.211746:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00080000:1.0:1783349829.211769:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349829.211959:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240192 00000100:00100000:2.0:1783349829.211963:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240192 00000100:00100000:2.0:1783349829.211991:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:2.0:1783349829.211998:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655240192:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349829.212035:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655240192:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349829.212041:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 266 00000100:00100000:0.0:1783349829.214317:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240320 00000100:00100000:0.0:1783349829.214332:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240320 00000100:00080000:1.0:1783349829.214466:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349829.214502:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240448 00000100:00100000:2.0:1783349829.214507:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240448 00000100:00100000:2.0:1783349829.214819:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1783349829.214831:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2360:x1869977655240320:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349829.214902:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2360:x1869977655240320:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 74us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349829.214910:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1783349829.214927:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:2.0:1783349829.214933:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655240448:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349829.214958:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655240448:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (3436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349829.214980:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00080000:1.0:1783349829.215031:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349829.288593:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349829.288853:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240704 00000100:00100000:0.0:1783349829.288865:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240704 00000100:00100000:0.0:1783349829.288932:0:11848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:0.0:1783349829.288943:0:11848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655240704:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:0.0:1783349829.288963:0:11848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349829.288984:0:11848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ac3649/0x68b4a22a48476b72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb6c expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349829.289013:0:11848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4bc240, atime: 0x6a4bc240, ctime: 0x6a4bc240, blocks: 0xb 00010000:00010000:0.0:1783349829.289047:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=216s v=(0 0) 00010000:00010000:0.0:1783349829.289052:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349829.289061:0:11848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ac3649/0x68b4a22a48476b72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb6c expref: 7 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.289080:0:11848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4ac3649/0x68b4a22a48476b72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb6c expref: 7 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349829.289093:0:11848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7a00, rc 0) 00000100:00100000:0.0:1783349829.289156:0:11848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2359:x1869977655240704:12345-192.168.204.36@tcp:101:cat.0 Request processed in 216us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349829.289164:0:11848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00010000:00010000:2.0:1783349829.290061:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349829.297119:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349829.297219:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240832 00000100:00100000:2.0:1783349829.297240:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240832 00002000:00100000:2.0:1783349829.297307:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9320c8613800 x1869977655240832/t0(0) o3->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:580/0 lens 488/0 e 0 to 0 dl 1783349840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349829.297319:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320c8613800 with x1869977655240832 ext(0->4095) 00002000:00010000:2.0:1783349829.297325:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320c8613800 00000100:00100000:2.0:1783349829.297358:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:2.0:1783349829.297367:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2360:x1869977655240832:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:2.0:1783349829.297613:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2360:x1869977655240832:12345-192.168.204.36@tcp:3:cat.0 Request processed in 246us (513us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783349829.297621:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00002000:00100000:2.0:1783349829.297627:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9320c8613800 x1869977655240832/t0(0) o3->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:580/0 lens 488/4536 e 0 to 0 dl 1783349840 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349829.297634:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320c8613800 with x1869977655240832 ext(0->4095) 00002000:00010000:2.0:1783349829.297637:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320c8613800 00010000:00010000:3.0:1783349830.313987:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349830.506179:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666775424:0@lo:400:kworker.0 00000100:00100000:0.0:1783349830.506262:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349830.506369:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666775424 00000100:00100000:1.0:1783349830.506379:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666775424 00000100:00100000:1.0:1783349830.506429:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783349830.506438:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666775424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506446:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666775808:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506478:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349830.506522:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666775808 00000100:00100000:3.0:1783349830.506541:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666775808 00000100:00100000:3.0:1783349830.506581:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783349830.506588:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666775808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506639:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666775808:12345-0@lo:400:kworker.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349830.506647:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783349830.506688:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666775808:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506723:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666775680:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506752:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349830.506775:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349830.506782:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666775552:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506831:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349830.506859:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666775680 00000100:00100000:3.0:1783349830.506863:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666775680 00000100:00100000:3.0:1783349830.506888:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666775552 00000100:00100000:3.0:1783349830.506891:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666775552 00000100:00100000:3.0:1783349830.506911:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783349830.506917:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666775680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.506953:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666775680:12345-0@lo:400:kworker.0 Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349830.506959:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783349830.506971:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783349830.506977:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666775552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.507002:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666775552:12345-0@lo:400:kworker.0 Request processed in 25us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349830.507007:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783349830.507039:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666775552:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.507048:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666775680:0@lo:400:kworker.0 00000100:00080000:3.0:1783349830.507090:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783349830.507095:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349830.510172:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349830.510194:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666775936:0@lo:400:kworker.0 00000100:00100000:2.0:1783349830.510194:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666776064:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.510420:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349830.510469:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666775936 00000100:00100000:3.0:1783349830.510477:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666775936 00000100:00100000:0.0:1783349830.510516:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666775424:0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.510559:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783349830.510570:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666775936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783349830.510578:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349830.510629:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666775936:12345-0@lo:400:kworker.0 Request processed in 60us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349830.510638:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783349830.510653:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666775936:0@lo:400:kworker.0 00000100:00100000:2.0:1783349830.512684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349830.512685:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666775424:12345-0@lo:400:kworker.0 Request processed in 6242us (6417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349830.512700:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783349830.512823:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776064 00000100:00100000:3.0:1783349830.512832:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776064 00000100:00100000:3.0:1783349830.512893:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783349830.512902:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666776064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349830.512955:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666776064:12345-0@lo:400:kworker.0 Request processed in 56us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349830.512960:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1783349830.513015:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349830.513070:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1783349830.513076:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1783349830.513096:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320ec481880, transno 4294967301 00000004:00080000:1.0:1783349830.513148:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1783349830.513160:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320fb46bb80, transno 4294967304 00000100:00100000:1.0:1783349830.514012:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666776064:0@lo:400:kworker.0 00000040:00080000:0.0:1783349830.954592:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349830.954601:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349830.954635:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783349830.954641:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349831.018235:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349831.018319:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349831.018476:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776192 00000100:00100000:0.0:1783349831.018484:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776192 00000100:00100000:0.0:1783349831.018557:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349831.018567:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666776192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349831.018611:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349831.018654:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666776192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349831.018662:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783349831.025442:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666776192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349831.338967:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783349832.101526:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1783349832.101561:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1783349832.101566:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:3.0:1783349832.101599:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320e408f240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783349832.101605:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320ec763b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320e408f780 00000020:00080000:3.0:1783349832.101608:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320ec763000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9320c6786000 00000001:00080000:3.0:1783349832.101618:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1783349832.101896:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783349832.102129:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1783349832.111810:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1783349832.111836:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1783349832.365873:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349832.570705:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349832.570994:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655240960 00000100:00100000:0.0:1783349832.571005:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655240960 00000100:00100000:0.0:1783349832.571092:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 134 00000100:00100000:0.0:1783349832.571114:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10197:x1869977655240960:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1783349832.571292:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349832.571404:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10197:x1869977655240960:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 302us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349832.571412:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 134 00000100:00100000:1.0:1783349832.589444:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349832.589576:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241216 00000100:00100000:2.0:1783349832.589586:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241216 00000100:00100000:2.0:1783349832.589638:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:2.0:1783349832.589647:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:10197:x1869977655241216:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349832.590482:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:10197:x1869977655241216:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 831us (1042us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783349832.590493:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:2.0:1783349832.821905:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349832.822003:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241344 00000100:00100000:0.0:1783349832.822013:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241344 00000100:00100000:0.0:1783349832.822092:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 135 00000100:00100000:0.0:1783349832.822101:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:10994:x1869977655241344:12345-192.168.204.36@tcp:101:lsof.0 00010000:00010000:0.0:1783349832.822231:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349832.822251:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476b79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb73 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349832.822321:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349832.822337:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349832.822348:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349832.822617:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783349832.822621:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349832.822710:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349832.822735:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476b79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349832.822752:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349832.822762:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:0.0:1783349832.822765:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349832.822768:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6800, rc 0) 00000100:00080000:3.0:1783349832.822938:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349832.823018:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+6:10994:x1869977655241344:12345-192.168.204.36@tcp:101:lsof.0 Request processed in 917us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349832.823025:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 135 00010000:00010000:3.0:1783349833.386203:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349834.090174:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783349834.090200:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666776320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349834.090279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349834.090478:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776320 00000100:00100000:0.0:1783349834.090488:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776320 00000100:00100000:0.0:1783349834.090616:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783349834.090627:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666776320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349834.090665:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349834.090721:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666776320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349834.090727:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783349834.091189:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1783349834.091197:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320c8610000, transno 4294967310 00000004:00080000:2.0:1783349834.091205:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1783349834.091234:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666776320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783349834.091993:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349834.333156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349834.333249:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349834.333281:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349834.333315:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349834.333355:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349834.333385:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241984 00000100:00100000:1.0:1783349834.333395:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241984 00000100:00100000:1.0:1783349834.333450:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241600 00000100:00100000:1.0:1783349834.333453:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241600 00000100:00100000:1.0:1783349834.333478:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:1.0:1783349834.333488:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:2359:x1869977655241984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349834.333564:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:2359:x1869977655241984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349834.333571:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:1.0:1783349834.333592:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:1.0:1783349834.333598:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:2359:x1869977655241600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349834.333646:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:2359:x1869977655241600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349834.333652:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:1.0:1783349834.333687:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241728 00000100:00100000:1.0:1783349834.333690:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241728 00000100:00100000:1.0:1783349834.333712:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241856 00000100:00100000:1.0:1783349834.333715:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241856 00000100:00100000:1.0:1783349834.333734:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1783349834.333739:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655241728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349834.333764:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655241728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349834.333771:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1783349834.333783:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:1.0:1783349834.333789:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655241856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349834.333837:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655241856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 48us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349834.333843:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00080000:1.0:1783349834.333871:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349834.333875:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349834.333877:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349834.334691:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655241472 00000100:00100000:3.0:1783349834.334699:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655241472 00000100:00100000:3.0:1783349834.334782:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 268 00000100:00100000:3.0:1783349834.334808:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655241472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349834.334860:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2359:x1869977655241472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 70us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349834.334867:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 268 00010000:00010000:3.0:1783349834.410090:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349835.226528:0:12140:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:57:13 (1783349833) 00010000:00010000:2.0:1783349835.434313:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349835.626443:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666776448:0@lo:400:kworker.0 00000100:00100000:3.0:1783349835.626482:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666776832:0@lo:400:kworker.0 00000100:00100000:3.0:1783349835.626557:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349835.626571:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349835.626627:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776832 00000100:00100000:1.0:1783349835.626641:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776832 00000100:00100000:0.0:1783349835.626651:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666776960:0@lo:400:kworker.0 00000100:00100000:2.0:1783349835.626676:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666776576:0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.626687:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349835.626710:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783349835.626725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349835.626726:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666776832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.626753:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776448 00000100:00100000:2.0:1783349835.626757:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666777088:0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.626759:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776448 00000100:00100000:2.0:1783349835.626818:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349835.626827:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666776832:12345-0@lo:400:kworker.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349835.626831:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783349835.626841:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666776448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349835.626863:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349835.626889:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666776448:12345-0@lo:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349835.626897:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783349835.626953:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666776832:0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.626954:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666776448:0@lo:400:kworker.0 00000100:00100000:3.0:1783349835.626991:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666776704:0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.626997:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776960 00000100:00100000:0.0:1783349835.627002:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776960 00000100:00100000:3.0:1783349835.627021:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349835.627277:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666777088 00000100:00100000:1.0:1783349835.627282:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666777088 00000100:00100000:1.0:1783349835.627313:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783349835.627321:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666777088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.627328:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776576 00000100:00100000:0.0:1783349835.627334:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776576 00000100:00100000:0.0:1783349835.627358:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666776704 00000100:00100000:0.0:1783349835.627362:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666776704 00000100:00100000:1.0:1783349835.627364:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666777088:12345-0@lo:400:kworker.0 Request processed in 44us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349835.627381:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783349835.627388:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666776960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.627426:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666776960:12345-0@lo:400:kworker.0 Request processed in 38us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349835.627433:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783349835.627444:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783349835.627451:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666776576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.627479:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666776576:12345-0@lo:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349835.627549:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783349835.627561:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783349835.627568:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349835.627599:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666776704:12345-0@lo:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349835.627605:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783349835.627639:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666776960:0@lo:400:kworker.0 00000100:00080000:0.0:1783349835.627668:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783349835.627674:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349835.628039:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666776704:0@lo:400:kworker.0 00000100:00100000:2.0:1783349835.628286:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666776576:0@lo:400:kworker.0 00000100:00100000:2.0:1783349835.628300:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666777088:0@lo:400:kworker.0 00000100:00100000:1.0:1783349835.628387:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783349836.070407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349836.070589:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655242240 00000100:00100000:0.0:1783349836.070611:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655242240 00000100:00080000:1.0:1783349836.070704:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349836.070747:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 136 00000100:00100000:0.0:1783349836.070768:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:11259:x1869977655242240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349836.070873:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349836.070903:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476b87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb7a expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071015:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071034:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071051:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071072:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071117:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071125:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071716:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071732:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.071742:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349836.071766:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783349836.072065:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072076:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072084:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072091:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349836.072112:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072121:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072151:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9320cf8b3300) 00010000:00010000:0.0:1783349836.072155:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349836.072164:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072171:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476b8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072189:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072196:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072202:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072209:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349836.072212:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072218:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072226:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9320c2913900) 00010000:00010000:0.0:1783349836.072229:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349836.072232:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.072238:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476b95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.073005:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476b87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb7a expref: 17 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.073032:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb7a expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349836.073041:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:0.0:1783349836.073044:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349836.073047:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:0.0:1783349836.073183:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:11259:x1869977655242240:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2422us (2788us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783349836.073194:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 136 00000100:00100000:3.0:1783349836.078060:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349836.078189:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349836.078306:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655242496 00000100:00100000:2.0:1783349836.078322:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655242496 00000100:00100000:2.0:1783349836.078412:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:2.0:1783349836.078425:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+16:2360:x1869977655242496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349836.078448:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349836.078482:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476b9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb7a expref: 16 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349836.078506:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:2.0:1783349836.078519:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349836.078594:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:2360:x1869977655242496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 172us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349836.078603:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:0.0:1783349836.081595:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655242368 00000100:00100000:0.0:1783349836.081622:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655242368 00000100:00100000:2.0:1783349836.081859:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 137 00000100:00100000:2.0:1783349836.081878:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:11259:x1869977655242368:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783349836.082999:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:11259:x1869977655242368:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 1114us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349836.083015:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 137 00000100:00100000:3.0:1783349836.138578:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666777216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349836.139006:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349836.139269:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666777216 00000100:00100000:2.0:1783349836.139284:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666777216 00000100:00100000:0.0:1783349836.143758:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783349836.143823:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666777216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349836.143906:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349836.144191:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666777216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 412us (5185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349836.144200:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783349836.144343:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666777216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783349836.459878:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783349837.102618:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349837.102635:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349837.103559:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783349837.103573:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1783349837.194132:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1783349837.194154:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1783349837.194178:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1783349837.194192:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783349837.468782:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.469090:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655242624 00000100:00100000:1.0:1783349837.469107:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655242624 00000100:00100000:1.0:1783349837.469268:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 138 00000100:00100000:1.0:1783349837.469281:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:11301:x1869977655242624:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349837.469312:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349837.469346:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb81 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469454:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469486:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469514:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469532:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469540:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469547:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469952:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469963:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469971:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469978:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349837.469983:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.469993:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470009:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:1.0:1783349837.470012:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349837.470018:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470032:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470047:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470054:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470061:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470078:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349837.470082:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470090:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470099:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9320e0103f00) 00010000:00010000:1.0:1783349837.470102:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349837.470105:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470111:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476bb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470159:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476baa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb81 expref: 14 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470183:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:1.0:1783349837.470185:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349837.470190:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb81 expref: 14 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.470201:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb800, rc 0) 00000100:00100000:1.0:1783349837.470293:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:11301:x1869977655242624:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1013us (1531us total) trans 0 rc 301/301 00000100:00100000:1.0:1783349837.470303:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 138 00000100:00100000:2.0:1783349837.480632:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.480687:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655242880 00000100:00100000:0.0:1783349837.480714:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655242880 00000100:00100000:0.0:1783349837.480825:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 139 00000100:00100000:0.0:1783349837.480839:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:11301:x1869977655242880:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:0.0:1783349837.480929:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349837.480967:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175aa00/0x68b4a22a48476528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9ba expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.480989:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:0.0:1783349837.480995:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349837.481397:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.481416:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.481429:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.481472:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.481490:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 5 pid: 5784 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.481510:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666777344:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349837.481641:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65a80 going to sleep for 11 seconds 00010000:00010000:3.0:1783349837.482140:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349837.488195:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.488246:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243008 00000100:00100000:0.0:1783349837.488269:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243008 00000100:00100000:3.0:1783349837.488324:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666777344:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349837.488344:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 6 pid: 5784 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.488360:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.488394:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:0.0:1783349837.488405:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a60ae5-4060-4be4-9464-772b1677edda+6:2362:x1869977655243008:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349837.488424:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349837.488433:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 6 pid: 5784 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.488446:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 6 pid: 5784 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.488478:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476b80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb73 expref: 6 pid: 5784 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.488498:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:0.0:1783349837.488503:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.488529:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.488537:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.488572:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349837.488647:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655243008:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 243us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.488665:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00080000:0.0:1783349837.488692:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783349837.489391:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.489404:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.489438:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.489450:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.489460:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349837.492674:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783349837.492704:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.492717:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.492727:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.492742:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349837.492749:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.492760:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.492781:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913200) 00010000:00010000:3.0:1783349837.492785:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349837.492819:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.492827:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476bbf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349837.492851:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dc73822 reply state 000000007c305c71 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349837.492863:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349837.493010:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:11301:x1869977655242880:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 12169us (12386us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1783349837.493021:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 139 00010000:00010000:2.0:1783349837.499990:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.500014:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.500024:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.500032:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349837.500038:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.500045:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.500075:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9320cf8b3000) 00010000:00010000:2.0:1783349837.500085:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349837.500091:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.500099:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476bc6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.566309:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.566527:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243136 00000100:00100000:2.0:1783349837.566550:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243136 00000100:00100000:2.0:1783349837.566646:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 140 00000100:00100000:2.0:1783349837.566660:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:11309:x1869977655243136:12345-192.168.204.36@tcp:101:lctl.0 00010000:00010000:2.0:1783349837.566703:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349837.566737:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb88 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.566987:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476bd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.567008:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.567149:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349837.567236:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783349837.567241:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349837.567278:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.567311:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb88 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.567360:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb88 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.567371:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:2.0:1783349837.567375:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349837.567380:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97800, rc 0) 00000100:00100000:2.0:1783349837.567466:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:11309:x1869977655243136:12345-192.168.204.36@tcp:101:lctl.0 Request processed in 809us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349837.567475:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 140 00000100:00100000:1.0:1783349837.601051:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.601283:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243264 00000100:00100000:2.0:1783349837.601299:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243264 00000100:00100000:2.0:1783349837.601384:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 141 00000100:00100000:2.0:1783349837.601406:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+14:11315:x1869977655243264:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349837.601439:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349837.601468:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb8f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601566:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601584:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601599:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601616:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601632:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601639:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601853:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601862:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601871:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349837.601915:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783349837.601919:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349837.601948:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601962:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601970:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601977:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.601983:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349837.601987:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602002:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602017:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:2.0:1783349837.602020:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349837.602026:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602032:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602050:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602056:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602061:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602076:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349837.602079:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602085:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.602093:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9320c3886300) 00010000:00010000:2.0:1783349837.602095:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349837.602098:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.603257:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476be9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.603315:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb8f expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.603331:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb8f expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.603340:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349837.603343:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783349837.603346:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96400, rc 0) 00000100:00100000:2.0:1783349837.603456:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:11315:x1869977655243264:12345-192.168.204.36@tcp:101:bash.0 Request processed in 2060us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349837.603468:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 141 00000100:00100000:1.0:1783349837.608874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.608934:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243520 00000100:00100000:0.0:1783349837.608947:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243520 00000100:00100000:0.0:1783349837.609015:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 142 00000100:00100000:0.0:1783349837.609025:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+15:11315:x1869977655243520:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349837.609053:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349837.609095:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476bf7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb96 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.609359:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.609379:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.609395:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.612036:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.612074:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.612089:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349837.613473:0:6605:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783349837.614478:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614497:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614509:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614548:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614555:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614562:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614568:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349837.614572:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614580:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614591:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:0.0:1783349837.614594:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349837.614598:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614604:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476bfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349837.614700:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a496c9ec reply state 00000000913baab1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.614709:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783349837.614751:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476bf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614766:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 17 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.614774:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:0.0:1783349837.614777:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349837.614779:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7200, rc 0) 00000100:00100000:0.0:1783349837.616599:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11315:x1869977655243520:12345-192.168.204.36@tcp:101:bash.0 Request processed in 7563us (7733us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783349837.616618:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 142 00000100:00100000:3.0:1783349837.620057:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.620977:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243648 00000100:00100000:0.0:1783349837.620992:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243648 00000100:00100000:0.0:1783349837.621084:0:11848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:0.0:1783349837.621096:0:11848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2359:x1869977655243648:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349837.621116:0:11848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349837.621139:0:11848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bb9d expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349837.621167:0:11848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783349837.621189:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=224s v=(0 0) 00010000:00010000:0.0:1783349837.621207:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349837.621216:0:11848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 6 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.621237:0:11848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 6 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.621250:0:11848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:0.0:1783349837.621313:0:11848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2359:x1869977655243648:12345-192.168.204.36@tcp:101:bash.0 Request processed in 220us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.621320:0:11848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00080000:2.0:1783349837.621389:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783349837.621911:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.621921:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.621929:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.621935:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349837.621939:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.621946:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.621960:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c2913b00) 00010000:00010000:1.0:1783349837.621970:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349837.621975:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.621982:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476c05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349837.624443:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.624606:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243776 00000100:00100000:0.0:1783349837.624621:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243776 00000100:00100000:0.0:1783349837.624773:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:0.0:1783349837.624786:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:11315:x1869977655243776:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349837.624862:0:7807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349837.624894:0:7807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bba4 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.624945:0:7807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.624958:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349837.624963:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349837.624970:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.625080:0:7807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.625100:0:7807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.625123:0:7807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7807:1869977666777472:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349837.625277:0:7807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349837.627311:0:7807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7807:1869977666777472:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349837.627364:0:7807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 7 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.627388:0:7807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6800, rc 0) 00000100:00100000:0.0:1783349837.627466:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:11315:x1869977655243776:12345-192.168.204.36@tcp:101:bash.0 Request processed in 2683us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.627476:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:3.0:1783349837.628532:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.628627:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655243904 00000100:00100000:0.0:1783349837.628638:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655243904 00010000:00010000:0.0:1783349837.628677:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.628747:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:0.0:1783349837.628754:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655243904:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349837.628788:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349837.628855:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.628871:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.628901:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e7729a/0x68b4a22a48476c1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb9d expref: 7 pid: 11848 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.628921:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349837.628926:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349837.628935:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 6 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.628947:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 6 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.628992:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 6 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.629023:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5770:1869977666777600:192.168.204.36@tcp:105: 00000100:00100000:0.0:1783349837.629140:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349837.631914:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5770:1869977666777600:192.168.204.36@tcp:105: 00010000:00010000:0.0:1783349837.631962:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349837.632094:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655243904:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3337us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.632109:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:1.0:1783349837.632455:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.632714:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655244160 00000100:00100000:0.0:1783349837.632724:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655244160 00000100:00100000:0.0:1783349837.632830:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:0.0:1783349837.632843:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:11315:x1869977655244160:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:0.0:1783349837.633489:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11315:x1869977655244160:12345-192.168.204.36@tcp:35:bash.0 Request processed in 644us (1031us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783349837.633499:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:1.0:1783349837.694534:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349837.695126:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655244416 00000100:00100000:3.0:1783349837.695145:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655244416 00000100:00100000:3.0:1783349837.695236:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 143 00000100:00100000:3.0:1783349837.695250:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11325:x1869977655244416:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349837.695283:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349837.695333:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbab expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349837.695498:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783349837.695665:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476c28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbab expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.695685:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:3.0:1783349837.695689:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349837.695696:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbab expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.695716:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003a00, rc 0) 00000100:00100000:3.0:1783349837.696267:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:11325:x1869977655244416:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1014us (1746us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1783349837.696278:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 143 00000100:00100000:2.0:1783349837.699438:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.699557:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655244672 00000100:00100000:1.0:1783349837.699572:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655244672 00000100:00100000:1.0:1783349837.699648:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:1.0:1783349837.699660:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:11325:x1869977655244672:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349837.700966:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11325:x1869977655244672:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1299us (1532us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783349837.700979:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:1.0:1783349837.755449:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.755580:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655244800 00000100:00100000:2.0:1783349837.755597:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655244800 00000100:00100000:2.0:1783349837.755682:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 144 00000100:00100000:2.0:1783349837.755695:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11331:x1869977655244800:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349837.755732:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349837.755764:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbb2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.755885:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476c3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.755923:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.755936:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349837.756023:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783349837.756027:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349837.756057:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.756101:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbb2 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.756125:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbb2 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.756135:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349837.756138:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349837.756142:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97200, rc 0) 00000100:00100000:2.0:1783349837.756290:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:11331:x1869977655244800:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 597us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349837.756299:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 144 00000100:00100000:3.0:1783349837.761645:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.761774:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655245056 00000100:00100000:2.0:1783349837.761788:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655245056 00000100:00100000:2.0:1783349837.761919:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 145 00000100:00100000:2.0:1783349837.761932:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:11331:x1869977655245056:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349837.761971:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349837.762008:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476c44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbb9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.762160:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476c4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.762176:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.762189:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349837.762202:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783349837.762361:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476c44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbb9 expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.762395:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbb9 expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.762404:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:2.0:1783349837.762407:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349837.762411:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97a00, rc 0) 00000100:00100000:2.0:1783349837.762556:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:11331:x1869977655245056:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 626us (927us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783349837.762565:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 145 00000100:00100000:3.0:1783349837.767540:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349837.767585:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.767597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655245312 00000100:00100000:2.0:1783349837.767611:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655245312 00000100:00100000:2.0:1783349837.767692:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 146 00000100:00100000:2.0:1783349837.767704:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:11331:x1869977655245312:12345-192.168.204.36@tcp:101:lfs.0 00000100:00100000:0.0:1783349837.767743:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655245440 00000100:00100000:0.0:1783349837.767748:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655245440 00010000:00010000:2.0:1783349837.767765:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349837.767817:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476c59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbc0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.767948:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476c60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.767968:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.767982:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476c60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349837.767998:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:0.0:1783349837.768085:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349837.768094:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:2361:x1869977655245440:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349837.768106:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349837.768126:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbb9 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.768146:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:0.0:1783349837.768151:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349837.768230:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+25:2361:x1869977655245440:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 137us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.768239:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00010000:00010000:2.0:1783349837.768457:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476c59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc0 expref: 25 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.768472:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476c60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc0 expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.768481:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:2.0:1783349837.768484:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783349837.768486:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97600, rc 0) 00000100:00100000:2.0:1783349837.768561:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:11331:x1869977655245312:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 860us (1033us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1783349837.768568:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 146 00000100:00100000:3.0:1783349837.774312:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.774601:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655245568 00000100:00100000:1.0:1783349837.774615:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655245568 00000100:00100000:1.0:1783349837.774733:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:1.0:1783349837.774746:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2360:x1869977655245568:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:1.0:1783349837.774841:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.774894:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 6 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.774906:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349837.774930:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783349837.774936:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.774983:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 6 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.774998:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 6 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349837.775036:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1869977666777728:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349837.775182:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349837.779369:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.779435:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6578:1869977666777728:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349837.779481:0:6578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349837.779780:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655245696 00000100:00100000:3.0:1783349837.779827:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655245696 00002000:00100000:3.0:1783349837.779889:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9320fb6c2300 x1869977655245696/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:588/0 lens 504/0 e 0 to 0 dl 1783349848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349837.779902:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320fb6c2300 with x1869977655245696 ext(0->12) 00010000:00010000:3.0:1783349837.779912:0:6585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 7 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.779949:0:6585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 7 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349837.779958:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320fb6c2300 00000100:00100000:3.0:1783349837.779993:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:3.0:1783349837.780002:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655245696:12345-192.168.204.36@tcp:4:lfs.0 00000100:00100000:3.0:1783349837.780677:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655245696:12345-192.168.204.36@tcp:4:lfs.0 Request processed in 672us (1315us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783349837.780687:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00002000:00100000:3.0:1783349837.780695:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9320fb6c2300 x1869977655245696/t4294967305(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:588/0 lens 504/448 e 0 to 0 dl 1783349848 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349837.780705:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320fb6c2300 with x1869977655245696 ext(0->12) 00010000:00010000:3.0:1783349837.780712:0:6585:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 9 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.780727:0:6585:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 9 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349837.780735:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320fb6c2300 00000100:00100000:2.0:1783349837.785491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.785621:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655245824 00000100:00100000:0.0:1783349837.785632:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655245824 00010000:00010000:0.0:1783349837.785675:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 9 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.785740:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:0.0:1783349837.785751:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2359:x1869977655245824:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349837.785767:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783349837.785784:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783349837.785787:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783349836 00002000:00010000:0.0:1783349837.785789:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783349836 00002000:00010000:0.0:1783349837.785830:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783349836 00010000:00010000:0.0:1783349837.785837:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 9 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.785851:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 9 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.785875:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d4b5c6b/0x68b4a22a48476c21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bba4 expref: 9 pid: 7807 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.785892:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349837.785896:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349837.785903:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.785914:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.785948:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349837.786000:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2359:x1869977655245824:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 251us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.786009:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 63 00010000:00010000:2.0:1783349837.786136:0:6578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786147:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786174:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786183:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786191:0:6578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786198:0:6578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349837.786202:0:6578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786211:0:6578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786226:0:6578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.786246:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d052bccf/0x68b4a22a48476c6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349837.786295:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2360:x1869977655245568:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 11552us (12003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349837.786304:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:2.0:1783349837.791492:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.791538:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655246080 00000100:00100000:0.0:1783349837.791550:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655246080 00000100:00100000:0.0:1783349837.791603:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:0.0:1783349837.791612:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:11331:x1869977655246080:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:0.0:1783349837.791675:0:5788:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476c60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc0 expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349837.791957:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1783349837.792005:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1783349837.792578:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1783349837.792633:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.792649:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.792659:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.792695:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 28 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.792709:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 28 pid: 6605 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.792722:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320facced80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5788:1869977666777856:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349837.792842:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349837.800428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349837.800517:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655246208 00000100:00100000:3.0:1783349837.800527:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655246208 00010000:00010000:3.0:1783349837.800567:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 29 pid: 6605 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349837.800627:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:3.0:1783349837.800637:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:2362:x1869977655246208:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349837.800657:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349837.800664:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 29 pid: 6605 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.800678:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 29 pid: 6605 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.800703:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349837.800708:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.800717:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.800724:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.800742:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349837.800826:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:2362:x1869977655246208:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 190us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349837.800835:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00010000:00010000:2.0:1783349837.801252:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb96 expref: 28 pid: 6605 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349837.801272:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320facced80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5788:1869977666777856:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349837.801294:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.801302:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.801307:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349837.801484:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1783349837.803297:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1783349837.803497:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb469c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666777984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783349837.803559:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349837.803644:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0bf6900 going to sleep for 11 seconds 00000100:00100000:3.0:1783349837.803684:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666777984 00000100:00100000:3.0:1783349837.803691:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666777984 00000100:00100000:3.0:1783349837.803886:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349837.803896:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1869977666777984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783349837.803993:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1869977666777984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349837.804000:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783349837.804094:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb469c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666777984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783349837.804542:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1783349837.804603:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666778112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783349837.804636:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349837.804704:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349837.804766:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320f70e9180 going to sleep for 11 seconds 00000100:00100000:0.0:1783349837.805194:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666778112 00000100:00100000:0.0:1783349837.805202:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666778112 00000100:00100000:0.0:1783349837.805234:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783349837.805243:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5788:x1869977666778112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783349837.805459:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5788:x1869977666778112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 216us (821us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783349837.805466:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783349837.805554:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5788:1869977666778112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783349837.805605:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1783349837.805644:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.805654:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.805673:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.805679:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349837.805683:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.805691:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.805705:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:1.0:1783349837.805708:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783349837.805712:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.805719:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476c75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349837.805988:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783349837.806104:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1783349837.806116:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 224868323398ns, next at 225868321510ns, rc = 0 00000001:00080000:1.0:1783349837.806122:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1783349837.806153:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c2913700) 00010000:00010000:1.0:1783349837.806157:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783349837.806165:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48476c60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc0 expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349837.806312:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:11331:x1869977655246080:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 14701us (14830us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1783349837.806342:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 38 00000020:00080000:1.0:1783349837.806347:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783349837.811741:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349837.811837:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655246336 00000100:00100000:3.0:1783349837.811847:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655246336 00000100:00100000:3.0:1783349837.811900:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 147 00000100:00100000:3.0:1783349837.811921:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:11331:x1869977655246336:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349837.811942:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349837.811959:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbc7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.812021:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc7 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.812035:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc7 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349837.812054:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:3.0:1783349837.812058:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349837.812073:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002400, rc 0) 00000100:00100000:3.0:1783349837.812136:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11331:x1869977655246336:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 218us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349837.812143:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 147 00000100:00100000:2.0:1783349837.819522:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.819710:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655246592 00000100:00100000:1.0:1783349837.819720:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655246592 00000100:00100000:1.0:1783349837.819780:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:1.0:1783349837.819879:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11331:x1869977655246592:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349837.820224:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:11331:x1869977655246592:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 433us (710us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1783349837.820233:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:0.0:1783349837.908316:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.908959:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655246848 00000100:00100000:1.0:1783349837.908971:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655246848 00000100:00100000:1.0:1783349837.909035:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 148 00000100:00100000:1.0:1783349837.909046:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+33:11341:x1869977655246848:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349837.909085:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349837.909106:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbce expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349837.909243:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783349837.909368:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476c83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbce expref: 35 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.909381:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:1.0:1783349837.909384:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349837.909388:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbce expref: 35 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.909420:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349837.909636:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:11341:x1869977655246848:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 591us (1330us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1783349837.909646:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 148 00000100:00100000:3.0:1783349837.914975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349837.915120:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655246976 00000100:00100000:0.0:1783349837.915135:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655246976 00000100:00100000:0.0:1783349837.915203:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 149 00000100:00100000:0.0:1783349837.915213:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:11341:x1869977655246976:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:0.0:1783349837.915309:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915327:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915351:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915367:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915374:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915380:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915509:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915519:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915526:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349837.915591:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915606:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915612:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915619:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915626:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349837.915629:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915636:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915648:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:0.0:1783349837.915651:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349837.915656:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915668:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915682:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915688:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915695:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915699:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349837.915702:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915709:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915716:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c2913700) 00010000:00010000:0.0:1783349837.915719:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349837.915721:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915726:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476c98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915741:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915746:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915756:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915761:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349837.915764:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915770:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915778:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:0.0:1783349837.915780:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349837.915783:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349837.915789:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476c9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349837.915930:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:11341:x1869977655246976:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 718us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349837.915939:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 149 00000100:00100000:3.0:1783349837.922890:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.923091:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655247232 00000100:00100000:1.0:1783349837.923102:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655247232 00000100:00100000:1.0:1783349837.923167:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:1.0:1783349837.923175:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:11341:x1869977655247232:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349837.923422:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:11341:x1869977655247232:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 246us (541us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1783349837.923429:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:3.0:1783349837.968310:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.969153:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655247488 00000100:00100000:1.0:1783349837.969168:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655247488 00000100:00100000:1.0:1783349837.969245:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 150 00000100:00100000:1.0:1783349837.969257:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:11344:x1869977655247488:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349837.969286:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349837.969421:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476ca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbd5 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969498:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969516:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969529:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969560:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969568:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969574:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969703:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969712:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.969718:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349837.969727:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783349837.971536:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971555:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971562:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971568:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349837.971573:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971599:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971615:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349837.971618:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349837.971624:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971630:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971647:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971653:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971658:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971663:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349837.971666:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971671:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971678:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103f00) 00010000:00010000:1.0:1783349837.971680:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349837.971683:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.971697:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.972126:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476ca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 38 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.972154:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 37 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349837.972172:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349837.972174:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349837.972177:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb400, rc 0) 00000100:00100000:1.0:1783349837.972289:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:11344:x1869977655247488:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3033us (3992us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1783349837.973469:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 150 00000100:00100000:3.0:1783349837.977660:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349837.977948:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655247616 00000100:00100000:2.0:1783349837.977960:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655247616 00000100:00100000:2.0:1783349837.978025:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 151 00000100:00100000:2.0:1783349837.978036:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:11344:x1869977655247616:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:2.0:1783349837.978131:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978150:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978163:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978200:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978206:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978212:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978217:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349837.978221:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978229:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978244:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349837.978247:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349837.978260:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349837.978268:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349837.978444:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:11344:x1869977655247616:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 409us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349837.978452:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 151 00000100:00100000:3.0:1783349837.980568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349837.980851:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655247872 00000100:00100000:1.0:1783349837.980862:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655247872 00000100:00100000:1.0:1783349837.980917:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:1.0:1783349837.980927:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:11344:x1869977655247872:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349837.981221:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:11344:x1869977655247872:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 295us (661us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1783349837.981229:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:3.0:1783349838.170303:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.172379:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655248128 00000100:00100000:2.0:1783349838.172395:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655248128 00000100:00100000:2.0:1783349838.172496:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 152 00000100:00100000:2.0:1783349838.172507:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:11375:x1869977655248128:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1783349838.172531:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349838.172556:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbdc expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.172670:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.172684:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.172696:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349838.172707:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783349838.172876:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbdc expref: 41 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.172894:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbdc expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.172915:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.172918:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349838.172921:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97000, rc 0) 00000100:00100000:2.0:1783349838.172988:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11375:x1869977655248128:12345-192.168.204.36@tcp:101:cat.0 Request processed in 484us (2696us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783349838.172994:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 152 00000100:00080000:0.0:1783349838.173164:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349838.177402:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.177596:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655248384 00000100:00100000:1.0:1783349838.177610:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655248384 00000100:00100000:1.0:1783349838.177673:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:1.0:1783349838.177684:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11375:x1869977655248384:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1783349838.178035:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:11375:x1869977655248384:12345-192.168.204.36@tcp:35:cat.0 Request processed in 351us (643us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1783349838.178044:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:3.0:1783349838.179855:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349838.179919:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655248512 00000100:00100000:0.0:1783349838.179929:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655248512 00000100:00100000:0.0:1783349838.179995:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:0.0:1783349838.180005:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:2362:x1869977655248512:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349838.180022:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349838.180049:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a48476cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbdc expref: 41 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.180094:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:0.0:1783349838.180099:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349838.184344:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:2362:x1869977655248512:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4307us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349838.184372:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:3.0:1783349838.220118:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349838.220454:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655248768 00000100:00100000:0.0:1783349838.221177:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655248768 00000100:00100000:0.0:1783349838.221243:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:0.0:1783349838.221253:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11381:x1869977655248768:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:0.0:1783349838.221287:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349838.221291:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783349838.221327:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476c3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbb2 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.221352:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:0.0:1783349838.221358:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349838.221385:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476ce5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbe3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.221515:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.221537:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 40 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.221548:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.221604:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 40 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.221622:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 40 pid: 6605 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349838.221642:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666778240:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349838.221784:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000001:00080000:2.0:1783349838.222612:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1783349838.222628:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1783349838.228654:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666778240:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349838.229126:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349838.229303:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.229458:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655248896 00000100:00100000:2.0:1783349838.229541:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655248896 00010000:00010000:2.0:1783349838.229607:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 41 pid: 6605 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349838.229662:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:2.0:1783349838.229681:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:2361:x1869977655248896:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349838.229703:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349838.229711:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 41 pid: 6605 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.229726:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 41 pid: 6605 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.229756:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbd5 expref: 41 pid: 6605 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.229775:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.230131:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.230151:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.230160:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.230187:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349838.230195:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.230207:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349838.230232:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783349838.230497:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476ce5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.230521:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.230529:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.230532:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349838.230535:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7000, rc 0) 00000100:00100000:2.0:1783349838.230668:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:2361:x1869977655248896:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 996us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.230685:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:1.0:1783349838.230906:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11381:x1869977655248768:12345-192.168.204.36@tcp:101:dd.0 Request processed in 9653us (10801us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1783349838.230916:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 153 00000100:00100000:2.0:1783349838.233639:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349838.233827:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655249152 00000100:00100000:0.0:1783349838.233841:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655249152 00000100:00100000:0.0:1783349838.234132:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 154 00000100:00100000:0.0:1783349838.234146:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11381:x1869977655249152:12345-192.168.204.36@tcp:36:dd.0 00010000:00010000:0.0:1783349838.235306:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.235335:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.235351:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349838.235429:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1783349838.235454:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee3c3680 reply state 00000000ae17172b transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349838.235487:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349838.235633:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:11381:x1869977655249152:12345-192.168.204.36@tcp:36:dd.0 Request processed in 1487us (2073us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1783349838.235643:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 154 00000020:00080000:0.0:1783349838.235649:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783349838.237721:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.237747:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.237755:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.237762:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.237769:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.237778:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.238119:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.238126:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.238150:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.238158:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476cfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349838.399636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349838.400031:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655249280 00000100:00100000:0.0:1783349838.400062:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655249280 00000100:00100000:0.0:1783349838.400212:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 155 00000100:00100000:0.0:1783349838.400225:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+42:11395:x1869977655249280:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:0.0:1783349838.400264:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349838.400296:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbea expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400406:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400426:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400442:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400461:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400469:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400477:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400628:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400642:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400651:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400702:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.400718:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 43 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349838.400736:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faccd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666778368:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349838.400932:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349838.405709:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.406305:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655249536 00000100:00100000:1.0:1783349838.406322:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655249536 00000100:00100000:1.0:1783349838.406412:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1783349838.406426:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:5566:x1869977655249536:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783349838.407038:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:5566:x1869977655249536:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 612us (1340us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1783349838.407078:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:2.0:1783349838.407256:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faccd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666778368:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349838.407302:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349838.408738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349838.408831:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655249664 00000100:00100000:3.0:1783349838.408843:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655249664 00010000:00010000:3.0:1783349838.408962:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 45 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349838.409084:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:3.0:1783349838.409097:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:2362:x1869977655249664:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349838.409116:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349838.409125:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 45 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.409142:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 45 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.409172:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476cec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbe3 expref: 45 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.409196:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:3.0:1783349838.409202:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.409234:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.409244:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.409294:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349838.409384:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:2362:x1869977655249664:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 282us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349838.409393:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00010000:00010000:2.0:1783349838.409482:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409494:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349838.409556:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783349838.409562:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349838.409592:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409611:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409625:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409633:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409641:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409660:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.409665:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409674:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409686:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349838.409690:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.409694:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409701:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476d08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409715:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409722:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409729:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409734:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.409737:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409743:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409763:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c2913900) 00010000:00010000:2.0:1783349838.409766:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.409769:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.409776:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48476d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.410728:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48476d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbea expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.410751:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbea expref: 43 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.410851:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.410854:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349838.410857:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:2.0:1783349838.410920:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:11395:x1869977655249280:12345-192.168.204.36@tcp:101:stat.0 Request processed in 10697us (11301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.410929:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 155 00000100:00100000:0.0:1783349838.457072:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.457217:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655249920 00000100:00100000:1.0:1783349838.457232:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655249920 00000100:00100000:1.0:1783349838.457577:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 156 00000100:00100000:1.0:1783349838.457589:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:11401:x1869977655249920:12345-192.168.204.36@tcp:36:truncate.0 00010000:00010000:1.0:1783349838.457739:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349838.457776:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476d16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbea expref: 43 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.458115:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.458124:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349838.458781:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.458913:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.458926:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349838.458991:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1783349838.459020:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d664abc reply state 000000002aa585cb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.459030:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349838.459170:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:11401:x1869977655249920:12345-192.168.204.36@tcp:36:truncate.0 Request processed in 1581us (2122us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1783349838.459180:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 156 00000020:00080000:1.0:1783349838.459205:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783349838.463951:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.464124:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.464135:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.464143:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.464149:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.464156:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.464176:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.464178:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.464182:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.464186:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.508446:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349838.551492:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.552305:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655250048 00000100:00100000:1.0:1783349838.552321:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655250048 00000100:00100000:1.0:1783349838.552397:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:1.0:1783349838.552413:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:11415:x1869977655250048:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:1.0:1783349838.552445:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349838.552473:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbf1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552587:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552606:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552622:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552641:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552649:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552661:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552890:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552897:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.552903:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349838.552950:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1783349838.552954:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349838.552975:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553060:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553072:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553079:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553087:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553094:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.553099:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553120:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553137:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349838.553141:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.553149:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553156:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553177:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553185:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553199:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553209:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.553212:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553219:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553229:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103500) 00010000:00010000:1.0:1783349838.553231:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.553234:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553240:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553283:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 46 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553294:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 45 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.553299:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.553300:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349838.553303:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacac00, rc 0) 00000100:00100000:1.0:1783349838.553391:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:11415:x1869977655250048:12345-192.168.204.36@tcp:101:stat.0 Request processed in 984us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.553408:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 157 00000100:00100000:0.0:1783349838.613455:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.613744:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655250304 00000100:00100000:2.0:1783349838.613760:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655250304 00000100:00100000:2.0:1783349838.613936:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:2.0:1783349838.613949:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+45:11425:x1869977655250304:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349838.613981:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349838.614008:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbf8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349838.614228:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783349838.614397:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf8 expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.614417:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:2.0:1783349838.614421:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349838.614427:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf8 expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.614445:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349838.614599:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:11425:x1869977655250304:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 643us (1150us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1783349838.614609:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 158 00000100:00100000:0.0:1783349838.618544:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.618877:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655250560 00000100:00100000:1.0:1783349838.618893:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655250560 00000100:00100000:1.0:1783349838.618978:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:1.0:1783349838.618992:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:11425:x1869977655250560:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349838.619592:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:11425:x1869977655250560:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 599us (1064us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1783349838.619603:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:0.0:1783349838.656306:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.656459:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655250816 00000100:00100000:2.0:1783349838.656486:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655250816 00000100:00100000:2.0:1783349838.656645:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:2.0:1783349838.656659:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+47:11431:x1869977655250816:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349838.656695:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349838.656717:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bbff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.656947:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.656965:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 48 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.656987:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.657035:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 48 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.657063:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 48 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349838.657084:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb46bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666778496:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349838.657234:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0bf6240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349838.662243:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.662398:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb46bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666778496:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349838.662437:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.662500:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655250944 00000100:00100000:1.0:1783349838.662512:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655250944 00010000:00010000:1.0:1783349838.662624:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 49 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.662673:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:1.0:1783349838.662685:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:2362:x1869977655250944:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349838.662708:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349838.662717:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 49 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.662733:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 49 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.662773:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbf1 expref: 49 pid: 5786 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.662909:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.662944:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.662958:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.662966:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.662997:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349838.663064:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.663073:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.663088:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:2362:x1869977655250944:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 403us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.663099:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 67 00000004:00200000:2.0:1783349838.663102:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783349838.663302:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 49 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.663325:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.663354:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.663358:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349838.663362:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:2.0:1783349838.663435:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:11431:x1869977655250816:12345-192.168.204.36@tcp:101:bash.0 Request processed in 6778us (7161us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1783349838.663446:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 159 00000100:00100000:0.0:1783349838.668205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.668313:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655251200 00000100:00100000:1.0:1783349838.668326:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655251200 00000100:00100000:1.0:1783349838.668453:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 160 00000100:00100000:1.0:1783349838.668465:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+48:11431:x1869977655251200:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:1.0:1783349838.669236:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.669263:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.669278:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349838.669358:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1783349838.669394:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026706fed reply state 000000002bf2c3a4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.669406:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349838.669606:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:11431:x1869977655251200:12345-192.168.204.36@tcp:36:bash.0 Request processed in 1141us (1468us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1783349838.669615:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 160 00000020:00080000:1.0:1783349838.669620:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783349838.671639:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.671660:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.671668:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.671676:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.671681:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.671690:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.671712:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.671716:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.671722:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.671729:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476d63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349838.676577:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.677037:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655251328 00000100:00100000:1.0:1783349838.677071:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655251328 00000100:00100000:1.0:1783349838.677290:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:1.0:1783349838.677302:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:11431:x1869977655251328:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349838.677338:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349838.677364:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc06 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.677483:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.677497:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.677504:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.677781:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.677894:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 51 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.677915:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666778624:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349838.678396:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c68240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349838.681351:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666778624:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349838.681397:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349838.681996:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349838.682094:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655251456 00000100:00100000:3.0:1783349838.682105:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655251456 00010000:00010000:3.0:1783349838.682439:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 52 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349838.682502:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:3.0:1783349838.682516:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:2361:x1869977655251456:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349838.682545:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349838.682556:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 52 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.682577:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 52 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.682620:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476d55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbff expref: 52 pid: 5785 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.682691:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:3.0:1783349838.682699:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.682714:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.682726:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349838.682784:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349838.682925:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.682937:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349838.683051:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783349838.683057:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349838.683096:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.683271:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc06 expref: 52 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.683296:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc06 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349838.683305:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:0.0:1783349838.683308:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349838.683312:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacba00, rc 0) 00000100:00100000:0.0:1783349838.683413:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:11431:x1869977655251328:12345-192.168.204.36@tcp:101:bash.0 Request processed in 6110us (6850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349838.683426:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 161 00000100:00100000:3.0:1783349838.685894:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:2361:x1869977655251456:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 3367us (3891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349838.685911:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:1.0:1783349838.687867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349838.687974:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655251712 00000100:00100000:3.0:1783349838.688386:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655251712 00000100:00100000:3.0:1783349838.688473:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:3.0:1783349838.688486:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+50:11431:x1869977655251712:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:3.0:1783349838.688925:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:11431:x1869977655251712:12345-192.168.204.36@tcp:35:bash.0 Request processed in 438us (1071us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1783349838.688938:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:3.0:1783349838.748915:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.749170:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655251968 00000100:00100000:2.0:1783349838.749190:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655251968 00000100:00100000:2.0:1783349838.749344:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:2.0:1783349838.749357:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:11441:x1869977655251968:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349838.749397:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349838.749430:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc0d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349838.749600:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783349838.749763:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc0d expref: 53 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.749782:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:2.0:1783349838.749786:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349838.749833:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc0d expref: 53 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.749851:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349838.749939:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:11441:x1869977655251968:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 585us (1041us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1783349838.749947:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 162 00000100:00100000:0.0:1783349838.756425:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.758369:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655252096 00000100:00100000:2.0:1783349838.758388:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655252096 00000100:00100000:2.0:1783349838.758488:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:2.0:1783349838.758499:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:11441:x1869977655252096:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:2.0:1783349838.758609:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758646:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758659:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758677:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758685:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758692:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758837:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758847:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758855:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349838.758906:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758921:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758941:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758959:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758966:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.758971:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758980:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.758993:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349838.758996:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.759000:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759007:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476d86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759021:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759027:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759033:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759038:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.759050:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759066:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759075:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c3886000) 00010000:00010000:2.0:1783349838.759077:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.759080:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759091:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759107:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759113:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759120:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759125:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349838.759128:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759135:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759142:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.759144:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349838.759147:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.759163:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349838.759264:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:11441:x1869977655252096:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 766us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.759272:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 163 00000100:00100000:0.0:1783349838.762011:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349838.762187:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655252352 00000100:00100000:3.0:1783349838.762200:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655252352 00000100:00100000:3.0:1783349838.762276:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:3.0:1783349838.762290:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:11441:x1869977655252352:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1783349838.762777:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:11441:x1869977655252352:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 487us (789us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783349838.762787:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:3.0:1783349838.793627:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.794160:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655252608 00000100:00100000:1.0:1783349838.794174:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655252608 00000100:00100000:1.0:1783349838.794310:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:1.0:1783349838.794324:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:11444:x1869977655252608:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349838.794362:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349838.794498:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc14 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794608:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794626:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794640:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794658:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794666:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794672:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794927:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794939:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.794947:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349838.794962:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783349838.795143:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795152:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795161:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795168:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.795173:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795182:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795198:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349838.795201:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.795207:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795226:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476da2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795245:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795252:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795258:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795264:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.795267:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795275:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795283:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103500) 00010000:00010000:1.0:1783349838.795286:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.795289:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795294:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476da9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795351:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476d9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc14 expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795365:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc14 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.795508:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.795510:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349838.795514:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb800, rc 0) 00000100:00100000:1.0:1783349838.796018:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11444:x1869977655252608:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1694us (2407us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1783349838.796029:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 164 00000100:00100000:0.0:1783349838.800608:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349838.800706:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.800858:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655252864 00000100:00100000:2.0:1783349838.800874:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655252864 00000100:00100000:2.0:1783349838.800979:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:2.0:1783349838.800992:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:2361:x1869977655252864:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349838.801020:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349838.801073:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc14 expref: 55 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.801106:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.801112:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349838.801245:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:2361:x1869977655252864:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 256us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.801257:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:1.0:1783349838.801383:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655252736 00000100:00100000:1.0:1783349838.801388:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655252736 00000100:00100000:1.0:1783349838.801456:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 165 00000100:00100000:1.0:1783349838.801465:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c9035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:11444:x1869977655252736:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1783349838.801550:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801569:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801581:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801615:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801623:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801631:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801638:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.801662:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801671:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801683:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.801686:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349838.801691:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.801697:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349838.801745:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c9035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:11444:x1869977655252736:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 281us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.801753:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 165 00000100:00100000:0.0:1783349838.805456:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.805559:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655253120 00000100:00100000:1.0:1783349838.805573:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655253120 00000100:00100000:1.0:1783349838.805672:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:1.0:1783349838.805684:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+54:11444:x1869977655253120:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:1.0:1783349838.806073:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11444:x1869977655253120:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 389us (630us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1783349838.806082:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:0.0:1783349838.909014:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.909218:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655253376 00000100:00100000:2.0:1783349838.909233:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655253376 00000100:00100000:2.0:1783349838.909318:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 166 00000100:00100000:2.0:1783349838.909330:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fade9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11462:x1869977655253376:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1783349838.909362:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349838.909393:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc1b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.909567:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476dcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.909586:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.909600:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476dcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349838.909613:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783349838.909785:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc1b expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.909860:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476dcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc1b expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.910163:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:2.0:1783349838.910169:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783349838.910174:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97c00, rc 0) 00000100:00100000:2.0:1783349838.910327:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fade9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11462:x1869977655253376:12345-192.168.204.36@tcp:101:cat.0 Request processed in 999us (1330us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783349838.910338:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 166 00000100:00100000:0.0:1783349838.939862:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349838.940119:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655253504 00000100:00100000:2.0:1783349838.940135:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655253504 00000100:00100000:2.0:1783349838.940224:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 167 00000100:00100000:2.0:1783349838.940237:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11463:x1869977655253504:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349838.940272:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349838.940320:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc22 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.940440:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.940461:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.940481:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349838.940573:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783349838.940578:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349838.940611:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.940645:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc22 expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.940666:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc22 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349838.940677:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349838.940680:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783349838.940684:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349838.940957:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11463:x1869977655253504:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 720us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349838.941081:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 167 00000100:00100000:0.0:1783349838.949449:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349838.950214:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655253888 00000100:00100000:3.0:1783349838.950232:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655253888 00000100:00100000:3.0:1783349838.950321:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:3.0:1783349838.950333:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11463:x1869977655253888:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1783349838.950880:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11463:x1869977655253888:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 545us (1444us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783349838.950890:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:0.0:1783349838.955724:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.956036:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254016 00000100:00100000:1.0:1783349838.956061:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254016 00000100:00100000:1.0:1783349838.956153:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:1.0:1783349838.956165:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c795c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11463:x1869977655254016:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:1.0:1783349838.956189:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783349838.956249:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc06 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.956280:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc1b expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.956295:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bbc7 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.956311:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320cf8b3800) 00010000:00010000:1.0:1783349838.956327:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349838.956417:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c795c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11463:x1869977655254016:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 254us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.956426:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:0.0:1783349838.961630:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.961844:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254144 00000100:00100000:1.0:1783349838.961860:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254144 00000100:00100000:1.0:1783349838.961952:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 168 00000100:00100000:1.0:1783349838.961971:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11463:x1869977655254144:12345-192.168.204.36@tcp:58:lfs.0 00010000:00010000:1.0:1783349838.962176:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.962556:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.962573:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349838.963401:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1783349838.963551:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11463:x1869977655254144:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 1583us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.963584:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 168 00000100:00100000:0.0:1783349838.983238:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349838.983409:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254272 00000100:00100000:1.0:1783349838.983418:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254272 00000100:00100000:1.0:1783349838.983546:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 169 00000100:00100000:1.0:1783349838.983558:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11465:x1869977655254272:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349838.983589:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349838.983611:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476def lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc29 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983685:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983701:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983712:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983730:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983737:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983743:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983906:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983941:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.983948:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349838.984000:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783349838.984005:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349838.984028:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984049:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984059:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984066:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984073:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984079:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.984083:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984089:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984101:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349838.984104:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.984114:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984121:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984137:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984143:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984149:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984153:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349838.984157:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984162:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984169:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103f00) 00010000:00010000:1.0:1783349838.984171:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349838.984174:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984179:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984213:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476def lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984238:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349838.984245:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:1.0:1783349838.984248:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349838.984250:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca200, rc 0) 00000100:00100000:1.0:1783349838.984683:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11465:x1869977655254272:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1125us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349838.984692:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 169 00000040:00080000:1.0:1783349839.146138:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349839.146151:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349839.146203:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783349839.146212:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349839.146398:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666778752:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349839.146652:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c68840 going to sleep for 11 seconds 00000100:00100000:1.0:1783349839.150674:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666778752:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349839.151611:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.151916:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254400 00000100:00100000:0.0:1783349839.151930:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254400 00000100:00100000:0.0:1783349839.151998:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 170 00000100:00100000:0.0:1783349839.152009:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11476:x1869977655254400:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783349839.152074:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783349839.152542:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11476:x1869977655254400:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 531us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.152551:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 170 00000100:00100000:3.0:1783349839.158659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.158946:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254528 00000100:00100000:2.0:1783349839.158975:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254528 00000100:00100000:2.0:1783349839.159083:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 171 00000100:00100000:2.0:1783349839.159096:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11476:x1869977655254528:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783349839.159217:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.159244:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.159259:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.161646:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162104:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162124:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162173:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162183:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162192:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349839.162243:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783349839.162249:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349839.162279:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162292:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162299:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162305:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162312:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349839.162316:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162323:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162336:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:2.0:1783349839.162339:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349839.162344:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162350:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48476e0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162367:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162373:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162379:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162391:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349839.162394:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162401:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162410:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9320c3886000) 00010000:00010000:2.0:1783349839.162413:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349839.162427:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162435:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48476e12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162454:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162461:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162467:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162473:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349839.162476:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162483:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162506:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:2.0:1783349839.162508:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349839.162512:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.162518:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.162652:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11476:x1869977655254528:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 3553us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349839.162665:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 171 00000100:00100000:3.0:1783349839.165695:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.165777:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254784 00000100:00100000:1.0:1783349839.165867:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254784 00000100:00100000:1.0:1783349839.166144:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:1.0:1783349839.166164:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:11476:x1869977655254784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349839.166198:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349839.166233:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476e20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc30 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166405:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166424:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166438:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349839.166451:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783349839.166587:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166596:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166604:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166612:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.166618:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166629:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166646:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:1.0:1783349839.166649:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349839.166656:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166674:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166726:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476e20 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc30 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166737:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:1.0:1783349839.166740:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349839.166743:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476e20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc30 expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.166754:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacaa00, rc 0) 00000100:00100000:1.0:1783349839.167280:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11476:x1869977655254784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1118us (1594us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1783349839.167290:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 172 00000100:00100000:1.0:1783349839.172643:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.172824:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655254912 00000100:00100000:2.0:1783349839.172842:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655254912 00000100:00100000:2.0:1783349839.172926:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:2.0:1783349839.172939:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11476:x1869977655254912:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783349839.173006:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783349839.173249:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11476:x1869977655254912:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 311us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349839.173269:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 173 00000100:00100000:3.0:1783349839.177561:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.177776:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655255168 00000100:00100000:2.0:1783349839.177938:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655255168 00000100:00100000:2.0:1783349839.178057:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:2.0:1783349839.178071:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11476:x1869977655255168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349839.178109:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349839.178114:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783349839.178158:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc22 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.178213:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349839.178220:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349839.178243:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc37 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783349839.179360:0:5784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1783349839.179693:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.179717:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.179732:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.180711:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476e35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc37 expref: 60 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.180760:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc37 expref: 59 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.180771:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:1.0:1783349839.180775:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349839.180923:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacbc00, rc 0) 00000100:00100000:1.0:1783349839.181082:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11476:x1869977655255168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3010us (3533us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1783349839.181093:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 174 00000100:00100000:1.0:1783349839.189277:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.190115:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655255424 00000100:00100000:3.0:1783349839.190131:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655255424 00000100:00100000:3.0:1783349839.190215:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:3.0:1783349839.190226:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11476:x1869977655255424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783349839.190307:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349839.190347:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc37 expref: 59 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190370:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320e0103f00) 00010000:00010000:3.0:1783349839.190391:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349839.190422:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190450:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190464:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190485:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190493:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190501:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190599:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190607:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190614:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190620:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349839.190625:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190634:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190643:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349839.190652:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349839.190659:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190666:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476e4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190678:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190684:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190690:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190696:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349839.190699:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190705:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190714:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfb72a14f (ffff9320cf8b3700) 00010000:00010000:3.0:1783349839.190716:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349839.190719:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.190724:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfb72a14f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.190869:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11476:x1869977655255424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 642us (1606us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783349839.192298:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 175 00000100:00100000:1.0:1783349839.200494:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.200589:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655255552 00000100:00100000:0.0:1783349839.200602:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655255552 00000100:00100000:0.0:1783349839.200676:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:0.0:1783349839.200687:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11476:x1869977655255552:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349839.200715:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349839.200743:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc3e expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.200787:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.200934:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.200949:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.203562:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.203601:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 59 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.203613:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:1.0:1783349839.203616:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349839.203620:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7000, rc 0) 00000100:00100000:1.0:1783349839.203737:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11476:x1869977655255552:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3050us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.203749:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 176 00000100:00100000:1.0:1783349839.212696:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.212852:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655255808 00000100:00100000:3.0:1783349839.212867:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655255808 00000100:00100000:3.0:1783349839.212960:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 177 00000100:00100000:3.0:1783349839.212973:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11476:x1869977655255808:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783349839.213129:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.213157:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.213174:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.213837:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666778880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349839.213930:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349839.214142:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666778880 00000100:00100000:2.0:1783349839.214163:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666778880 00000040:00080000:3.0:1783349839.214216:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1783349839.214237:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 226276443827ns, next at 227276439130ns, rc = 0 00000100:00100000:2.0:1783349839.214268:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1783349839.214278:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349839.214286:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666778880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349839.214341:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000004:00010000:3.0:1783349839.214411:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c42fefb0 reply state 0000000074561b62 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.214426:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349839.214455:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666778880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349839.214464:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783349839.214533:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f70c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666778880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349839.215165:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11476:x1869977655255808:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 2192us (2488us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783349839.215175:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 177 00010000:00010000:1.0:1783349839.219087:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.219108:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.219116:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.219122:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.219127:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.219134:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.219154:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:1.0:1783349839.219158:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783349839.219163:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.219170:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476e66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.220200:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.221733:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655255936 00000100:00100000:1.0:1783349839.221748:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655255936 00000100:00100000:1.0:1783349839.221841:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 178 00000100:00100000:1.0:1783349839.221852:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11476:x1869977655255936:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349839.221876:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349839.221897:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc45 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.221991:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.222008:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.222028:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:1.0:1783349839.222031:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349839.222047:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca800, rc 0) 00000100:00100000:1.0:1783349839.222119:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11476:x1869977655255936:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 269us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.222126:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 178 00000100:00100000:2.0:1783349839.227637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.227929:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655256064 00000100:00100000:1.0:1783349839.227941:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655256064 00000100:00100000:1.0:1783349839.228020:0:11848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:1.0:1783349839.228048:0:11848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655256064:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783349839.228413:0:11848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655256064:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 383us (785us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1783349839.228422:0:11848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00080000:2.0:1783349839.228510:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349839.232451:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.232542:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655256320 00000100:00100000:1.0:1783349839.232561:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655256320 00000100:00100000:1.0:1783349839.232653:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:1.0:1783349839.232667:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11476:x1869977655256320:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783349839.233053:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11476:x1869977655256320:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 387us (616us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1783349839.233078:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:0.0:1783349839.235319:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.235430:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655256576 00000100:00100000:1.0:1783349839.235440:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655256576 00000100:00100000:1.0:1783349839.235500:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 179 00000100:00100000:1.0:1783349839.235510:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11476:x1869977655256576:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783349839.235684:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11476:x1869977655256576:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 175us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.235693:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 179 00000100:00100000:2.0:1783349839.247051:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.247258:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655256704 00000100:00100000:0.0:1783349839.247273:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655256704 00000100:00100000:0.0:1783349839.247344:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:0.0:1783349839.247355:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11476:x1869977655256704:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349839.247378:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349839.247402:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476e74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc4c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.247506:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.247521:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.247532:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349839.247569:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349839.247589:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.247621:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a48476e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc4c expref: 64 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.247650:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc4c expref: 63 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.247664:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:0.0:1783349839.247668:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783349839.247672:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:0.0:1783349839.247757:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11476:x1869977655256704:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 403us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.247766:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 180 00000100:00100000:2.0:1783349839.253333:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.253462:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655256832 00000100:00100000:0.0:1783349839.253475:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655256832 00000100:00100000:0.0:1783349839.253537:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:0.0:1783349839.253547:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655256832:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349839.253567:0:7807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349839.253589:0:7807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc53 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349839.253619:0:7807:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc24e, blocks: 0x1 00010000:00010000:0.0:1783349839.253639:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=226s v=(0 0) 00010000:00010000:0.0:1783349839.253645:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349839.253655:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 8 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.253674:0:7807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 8 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.253710:0:7807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6a00, rc 0) 00000100:00100000:0.0:1783349839.253871:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655256832:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 324us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.253880:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:1.0:1783349839.260663:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.260765:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257088 00000100:00100000:3.0:1783349839.260779:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257088 00000100:00100000:1.0:1783349839.261838:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:1.0:1783349839.261859:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11476:x1869977655257088:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783349839.262031:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11476:x1869977655257088:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 180us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.262051:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 181 00000100:00100000:2.0:1783349839.271993:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.272110:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257216 00000100:00100000:1.0:1783349839.272126:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257216 00000100:00100000:1.0:1783349839.272214:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:1.0:1783349839.272226:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:11476:x1869977655257216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349839.272252:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349839.272652:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc5a expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.272700:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.272730:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349839.272735:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349839.272756:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 9 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.272840:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.272858:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.272879:0:6578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6578:1869977666779008:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349839.273019:0:6578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c68840 going to sleep for 11 seconds 00000100:00100000:3.0:1783349839.277361:0:6578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6578:1869977666779008:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349839.277401:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 9 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.277441:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca000, rc 0) 00000100:00100000:3.0:1783349839.277534:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:11476:x1869977655257216:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 5308us (5562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349839.277543:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:3.0:1783349839.277681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.277766:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257344 00000100:00100000:3.0:1783349839.277773:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257344 00010000:00010000:3.0:1783349839.277826:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.277853:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:3.0:1783349839.277861:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2362:x1869977655257344:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349839.277877:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349839.277898:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.277911:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.277934:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476e82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc53 expref: 9 pid: 7807 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.277949:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349839.277953:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349839.277967:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.277984:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.278019:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.278046:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1869977666779136:192.168.204.36@tcp:105: 00000100:00100000:3.0:1783349839.278120:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349839.288342:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5770:1869977666779136:192.168.204.36@tcp:105: 00010000:00010000:0.0:1783349839.288396:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349839.288526:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655257344:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 10662us (10842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.288543:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:2.0:1783349839.289873:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.289993:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257472 00000100:00100000:3.0:1783349839.290007:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257472 00002000:00100000:3.0:1783349839.290085:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff931fc5909880 x1869977655257472/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:590/0 lens 504/0 e 0 to 0 dl 1783349850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349839.290100:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff931fc5909880 with x1869977655257472 ext(0->8) 00002000:00010000:3.0:1783349839.290109:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931fc5909880 00000100:00100000:3.0:1783349839.290143:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:3.0:1783349839.290154:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655257472:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783349839.290885:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2361:x1869977655257472:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 726us (1018us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783349839.290896:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00002000:00100000:3.0:1783349839.290906:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff931fc5909880 x1869977655257472/t4294967314(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:590/0 lens 504/448 e 0 to 0 dl 1783349850 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349839.290915:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff931fc5909880 with x1869977655257472 ext(0->8) 00002000:00010000:3.0:1783349839.290927:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff931fc5909880 00000100:00100000:2.0:1783349839.292935:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.293020:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257600 00000100:00100000:0.0:1783349839.293042:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257600 00000100:00100000:0.0:1783349839.293114:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 182 00000100:00100000:0.0:1783349839.293126:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11476:x1869977655257600:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783349839.329241:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000001:00080000:2.0:1783349839.329287:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:1.0:1783349839.329470:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+46:11476:x1869977655257600:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 36337us (36539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.329485:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 182 00000004:00080000:2.0:1783349839.329522:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783349839.329554:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320f70e9f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783349839.329559:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb4a9100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320f70e90c0 00000020:00080000:2.0:1783349839.329562:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb4a9300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff931fc4de9400 00000004:00080000:2.0:1783349839.329641:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1783349839.329767:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666779264:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783349839.329783:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1783349839.329872:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349839.329904:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666779392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783349839.329947:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349839.330001:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666779264 00000100:00100000:2.0:1783349839.330011:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666779264 00000100:00100000:2.0:1783349839.330076:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666779392 00000100:00100000:2.0:1783349839.330079:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666779392 00000100:00100000:2.0:1783349839.330110:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783349839.330121:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666779264:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783349839.330144:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:0.0:1783349839.330147:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1783349839.330155:0:6579:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00100000:0.0:1783349839.330171:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783349839.330181:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666779392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783349839.330197:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4bc24c, atime: 0x6a4bc24c, ctime: 0x6a4bc24c, blocks: 0xb 00010000:00010000:2.0:1783349839.330208:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.330228:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=226s v=(0 0) 00010000:00010000:2.0:1783349839.330233:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349839.330241:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.330260:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.330271:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.330279:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.330319:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783349839.330341:0:7807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783349839.330346:0:7807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783349838 00002000:00010000:0.0:1783349839.330349:0:7807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783349839.330351:0:7807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783349838 -> 1783349838 00002000:00010000:0.0:1783349839.330353:0:7807:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783349839.330404:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1869977666779392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 224us (457us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783349839.330411:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1783349839.330472:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349839.330480:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.330489:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349839.330494:0:7481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.330501:0:7481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.330517:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.330523:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a48476e90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.330545:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349839.330547:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349839.330549:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783349839.330643:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff931fc5908e00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1783349839.330652:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666779392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783349839.330912:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1869977666779264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 793us (1040us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783349839.330921:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349839.330945:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1783349839.330953:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1783349839.331074:0:3292:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9320fb4d3b80 x1869977666779264/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783349855 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783349839.331086:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320fb4d3b80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1783349839.331092:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666779264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783349839.332154:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.332273:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257728 00000100:00100000:0.0:1783349839.332285:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257728 00000100:00100000:0.0:1783349839.332377:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:0.0:1783349839.332389:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2362:x1869977655257728:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783349839.380358:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1783349839.380410:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1783349839.380436:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1783349839.380712:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655257728:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 48317us (48557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.380727:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:3.0:1783349839.385240:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.385377:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655257984 00000100:00100000:1.0:1783349839.385392:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655257984 00000100:00100000:1.0:1783349839.385507:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 183 00000100:00100000:1.0:1783349839.385520:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11476:x1869977655257984:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349839.385601:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349839.385634:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48476e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc4c expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.385664:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:1.0:1783349839.385670:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349839.385707:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.385722:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.385733:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349839.386213:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bbe98cd reply state 00000000edd94fb0 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.386228:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349839.386427:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:11476:x1869977655257984:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 906us (1200us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783349839.386437:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 183 00010000:00010000:3.0:1783349839.388080:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.388100:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.388132:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.388140:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349839.388146:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.388156:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.388185:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:3.0:1783349839.388189:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349839.388194:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.388201:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48476e97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.392219:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.392326:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655258112 00000100:00100000:0.0:1783349839.392349:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655258112 00000100:00100000:0.0:1783349839.392433:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:0.0:1783349839.392446:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655258112:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783349839.393202:0:7807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783349839.393208:0:7807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783349838 -> 1783349837 00002000:00010000:0.0:1783349839.393211:0:7807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783349836 00002000:00010000:0.0:1783349839.393213:0:7807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783349838 -> 1783349837 00002000:00010000:0.0:1783349839.393215:0:7807:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783349839.393298:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655258112:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 853us (1095us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783349839.393307:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:1.0:1783349839.398363:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.398437:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655258368 00000100:00100000:1.0:1783349839.398450:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655258368 00000100:00100000:1.0:1783349839.398522:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:1.0:1783349839.398532:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11476:x1869977655258368:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783349839.398637:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.398658:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.398668:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.398725:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 18 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.398767:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 18 pid: 6605 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.398787:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666779520:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349839.398954:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec503cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349839.404221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.404357:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666779520:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349839.404408:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.405094:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655258496 00000100:00100000:3.0:1783349839.405104:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655258496 00010000:00010000:3.0:1783349839.405152:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 19 pid: 6605 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.405209:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:3.0:1783349839.405219:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:2361:x1869977655258496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349839.405238:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349839.405245:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 19 pid: 6605 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.405282:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 19 pid: 6605 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.405310:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc3e expref: 19 pid: 6605 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.405333:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:3.0:1783349839.405343:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.405355:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.405365:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.405400:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349839.405442:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405453:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.405476:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:2361:x1869977655258496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 256us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349839.405486:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 70 00010000:00010000:1.0:1783349839.405491:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405501:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405509:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405516:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.405522:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405530:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405551:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:1.0:1783349839.405554:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783349839.405559:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.405566:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476e9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.405621:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:11476:x1869977655258368:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 7089us (7274us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783349839.405632:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 184 00000100:00100000:3.0:1783349839.412758:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.412916:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655258624 00000100:00100000:2.0:1783349839.412935:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655258624 00000100:00100000:2.0:1783349839.413046:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:2.0:1783349839.413058:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655258624:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783349839.413131:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.413164:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.413176:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349839.413181:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349839.413186:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.413238:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.413702:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 8 pid: 6578 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.413734:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1869977666779648:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349839.414522:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783349839.422013:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.422221:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1869977666779648:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349839.422335:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.422406:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655258752 00000100:00100000:0.0:1783349839.422416:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655258752 00010000:00010000:0.0:1783349839.422531:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 9 pid: 6578 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.422577:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:0.0:1783349839.422588:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655258752:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349839.422608:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349839.422636:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 9 pid: 6578 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.422648:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 9 pid: 6578 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.422690:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b40f56a4/0x68b4a22a48476e89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc5a expref: 9 pid: 6578 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.422707:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349839.422712:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349839.422719:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.422730:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.422759:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349839.422876:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422887:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422925:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422935:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422944:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422951:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349839.422963:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422973:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422986:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.422993:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48476ea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.423277:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655258752:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 688us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.423287:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:1.0:1783349839.424281:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2361:x1869977655258624:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 11220us (11535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.424293:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:2.0:1783349839.429210:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.429263:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259008 00000100:00100000:3.0:1783349839.429289:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259008 00000100:00100000:3.0:1783349839.429359:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 185 00000100:00100000:3.0:1783349839.429371:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:11476:x1869977655259008:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783349839.429476:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429498:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429511:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429822:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429835:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429844:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429890:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.429906:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 18 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.429925:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666779776:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349839.430049:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349839.431957:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.431957:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666779776:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349839.431993:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.432060:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259136 00000100:00100000:3.0:1783349839.432079:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259136 00010000:00010000:3.0:1783349839.432160:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.432210:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:3.0:1783349839.432222:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:2362:x1869977655259136:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349839.432242:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349839.432251:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432265:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432292:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc45 expref: 19 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432310:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:3.0:1783349839.432315:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432324:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432332:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432355:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349839.432421:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:2362:x1869977655259136:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 199us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349839.432440:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00010000:00010000:3.0:1783349839.432466:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.432473:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349839.436562:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1783349839.436913:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1783349839.436978:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1783349839.437139:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c6798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5786:1869977666779904:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783349839.437244:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349839.437358:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b37540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349839.438330:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666779904 00000100:00100000:1.0:1783349839.438346:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666779904 00000100:00100000:1.0:1783349839.438521:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783349839.438535:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1869977666779904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783349839.438719:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1869977666779904:12345-0@lo:1000:mdt00_002.0 Request processed in 187us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.438729:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783349839.439214:0:5786:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1783349839.439224:0:5786:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff931fc5908e00, transno 4294967315 00000100:00100000:2.0:1783349839.439252:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c6798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5786:1869977666779904:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783349839.439969:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1783349839.440108:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5786:1869977666780032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783349839.440686:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349839.440779:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c68533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349839.440946:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666780032 00000100:00100000:3.0:1783349839.440958:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666780032 00000100:00100000:2.0:1783349839.441312:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349839.441329:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1869977666780032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783349839.441712:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5786:x1869977666780032:12345-0@lo:1000:mdt00_002.0 Request processed in 386us (1027us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783349839.441722:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349839.441857:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5786:1869977666780032:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783349839.441934:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.441948:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.441957:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.441965:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349839.441971:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.441993:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442017:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:0.0:1783349839.442022:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349839.442041:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442048:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476eb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442087:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442093:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442099:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442104:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349839.442107:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442113:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442122:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:0.0:1783349839.442124:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349839.442127:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442143:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476de8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442174:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442191:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442203:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442247:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.442264:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 21 pid: 5786 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.442281:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666780160:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349839.442382:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d15ca9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349839.452342:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.452432:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259264 00000100:00100000:0.0:1783349839.452444:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259264 00000100:00100000:1.0:1783349839.452461:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666780160:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349839.452499:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 22 pid: 5786 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.452509:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.452553:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:0.0:1783349839.452564:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:2361:x1869977655259264:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349839.452585:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349839.452600:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 22 pid: 5786 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.452615:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 22 pid: 5786 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.452644:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc29 expref: 22 pid: 5786 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.452661:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:0.0:1783349839.452667:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.452678:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.452686:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.452719:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349839.452789:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:2361:x1869977655259264:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 226us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.453002:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 73 00010000:00010000:1.0:1783349839.453401:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453412:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.453420:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1783349839.453432:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453440:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453449:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453456:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.453461:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453471:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453487:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:1.0:1783349839.453491:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.453496:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453504:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476eba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453533:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453540:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453548:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453554:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.453558:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.453562:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00010000:00010000:1.0:1783349839.453570:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453580:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103500) 00010000:00010000:1.0:1783349839.453582:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783349839.453586:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.453593:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476eac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.453603:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.453636:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259648 00000100:00100000:2.0:1783349839.453645:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259648 00000100:00100000:2.0:1783349839.453711:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:2.0:1783349839.453725:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655259648:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349839.453847:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2362:x1869977655259648:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349839.453857:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:1.0:1783349839.453920:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11476:x1869977655259008:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 24550us (24723us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1783349839.453930:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 185 00000020:00080000:1.0:1783349839.453934:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783349839.454078:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349839.454084:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783349839.454155:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259392 00000100:00100000:3.0:1783349839.454161:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259392 00000100:00100000:3.0:1783349839.454250:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00100000:3.0:1783349839.454259:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2362:x1869977655259392:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349839.454295:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2362:x1869977655259392:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 38us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349839.454303:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 270 00000100:00080000:2.0:1783349839.454885:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349839.454907:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259520 00000100:00100000:2.0:1783349839.454916:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259520 00000100:00100000:2.0:1783349839.454990:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:2.0:1783349839.455000:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655259520:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349839.455067:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655259520:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 68us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349839.455076:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00000040:00080000:1.0:1783349839.455300:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1783349839.455315:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:3.0:1783349839.455890:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349839.461393:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.461534:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655259904 00000100:00100000:3.0:1783349839.461549:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655259904 00000100:00100000:3.0:1783349839.461632:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:3.0:1783349839.461647:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11476:x1869977655259904:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783349839.462754:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783349839.462930:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1783349839.468009:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.468055:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.468074:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.468086:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.468094:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.468101:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.468126:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349839.468146:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349839.468156:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.468166:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349839.468171:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.468181:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.468199:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9320e0103500) 00010000:00010000:3.0:1783349839.468203:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349839.468208:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.468216:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48476ec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.468245:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349839.468248:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349839.468250:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349839.468376:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:11476:x1869977655259904:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 6718us (6983us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1783349839.468388:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00000020:00080000:1.0:1783349839.468397:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783349839.532462:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783349839.703300:0:12290:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783349839.703313:0:12290:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783349839.703370:0:12290:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1783349839.703376:0:12290:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349839.790482:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.790551:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655260160 00000100:00100000:2.0:1783349839.790567:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655260160 00000100:00100000:2.0:1783349839.790692:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00100000:2.0:1783349839.790706:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:11486:x1869977655260160:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349839.790743:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349839.790774:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc61 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.791185:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ecf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.791214:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.791228:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349839.792702:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783349839.794676:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48476ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc61 expref: 25 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.794705:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc61 expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.794715:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349839.794727:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783349839.794731:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97a00, rc 0) 00000100:00100000:3.0:1783349839.794964:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:11486:x1869977655260160:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 4260us (4499us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1783349839.794973:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 186 00000100:00100000:2.0:1783349839.798949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.799067:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655260288 00000100:00100000:1.0:1783349839.799081:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655260288 00000100:00100000:1.0:1783349839.799238:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:1.0:1783349839.799250:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:11486:x1869977655260288:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:1.0:1783349839.799354:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.799393:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.799408:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.799430:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.799439:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.799446:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800048:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800058:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800065:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349839.800848:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800871:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800879:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800970:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800979:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.800985:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.800995:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801013:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349839.801016:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.801031:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801039:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801054:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801060:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801066:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801070:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.801073:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801088:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801097:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103900) 00010000:00010000:1.0:1783349839.801100:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.801103:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801248:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801284:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801290:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801296:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801301:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.801304:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801311:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801319:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103000) 00010000:00010000:1.0:1783349839.801321:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.801324:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.801339:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.801468:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:11486:x1869977655260288:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 2214us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.801479:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 187 00000100:00100000:3.0:1783349839.836126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.836485:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655260544 00000100:00100000:1.0:1783349839.836499:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655260544 00000100:00100000:1.0:1783349839.836592:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 188 00000100:00100000:1.0:1783349839.836604:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+24:11489:x1869977655260544:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349839.836636:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349839.836667:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476ef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc68 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.836782:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.836822:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.836837:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.836854:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.836860:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.836881:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837364:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837374:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837382:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349839.837395:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783349839.837520:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837529:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837537:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837544:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.837549:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837558:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837574:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349839.837577:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.837590:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837597:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837611:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837617:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837623:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837628:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.837631:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837637:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837949:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103000) 00010000:00010000:1.0:1783349839.837953:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.837958:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.837964:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a48476f00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.838042:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a48476ef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.838071:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 26 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.838079:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:1.0:1783349839.838082:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349839.838085:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacbc00, rc 0) 00000100:00100000:1.0:1783349839.838617:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11489:x1869977655260544:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 2011us (2502us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783349839.838628:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 188 00000100:00100000:0.0:1783349839.846153:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.846290:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655260672 00000100:00100000:1.0:1783349839.846303:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655260672 00000100:00100000:1.0:1783349839.846397:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00100000:1.0:1783349839.846410:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11489:x1869977655260672:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1783349839.846704:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846725:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846739:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846769:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846776:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846836:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846845:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.846850:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846860:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846879:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:1.0:1783349839.846883:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349839.846890:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.846897:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a48476f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.847001:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11489:x1869977655260672:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 593us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.847010:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 189 00000100:00100000:1.0:1783349839.849317:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.849676:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655260928 00000100:00100000:3.0:1783349839.849689:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655260928 00000100:00100000:3.0:1783349839.849788:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:3.0:1783349839.849819:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11489:x1869977655260928:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1783349839.850151:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:11489:x1869977655260928:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 334us (845us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783349839.850165:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:2.0:1783349839.876212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349839.876290:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655261184 00000100:00100000:2.0:1783349839.876304:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655261184 00000100:00100000:2.0:1783349839.876390:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:2.0:1783349839.876402:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:11025:x1869977655261184:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349839.876445:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349839.876472:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476f1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc6f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.876614:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.876639:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 28 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.876650:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.876852:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 28 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349839.876869:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 28 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.876887:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5908a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666780288:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349839.877013:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349839.880419:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5908a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666780288:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349839.880475:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349839.882228:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.882539:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655261312 00000100:00100000:1.0:1783349839.882559:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655261312 00010000:00010000:1.0:1783349839.882629:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 29 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.882682:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:1.0:1783349839.882693:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:2361:x1869977655261312:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349839.882723:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349839.882732:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 29 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.882749:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 29 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.882778:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48476f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc68 expref: 29 pid: 5784 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.882837:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:1.0:1783349839.882843:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.882855:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.882864:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.882891:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349839.882960:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:2361:x1869977655261312:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 268us (743us total) trans 0 rc 0/0 00010000:00010000:3.0:1783349839.883891:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.883905:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349839.883932:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783349839.884169:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a48476f1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 30 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.884193:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.884204:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:3.0:1783349839.884207:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783349839.884218:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97200, rc 0) 00000100:00100000:3.0:1783349839.884272:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:11025:x1869977655261184:12345-192.168.204.36@tcp:101:bash.0 Request processed in 7871us (8074us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783349839.884283:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 190 00000100:00100000:1.0:1783349839.884311:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:1.0:1783349839.887143:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.887282:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655261568 00000100:00100000:3.0:1783349839.887295:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655261568 00000100:00100000:3.0:1783349839.887397:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 191 00000100:00100000:3.0:1783349839.887409:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:11025:x1869977655261568:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:3.0:1783349839.887772:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.887839:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.887854:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349839.887921:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1783349839.887950:0:6605:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f23b8830 reply state 00000000b0c39764 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.887960:0:6605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783349839.888034:0:6605:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1783349839.888180:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11025:x1869977655261568:12345-192.168.204.36@tcp:36:bash.0 Request processed in 770us (1059us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783349839.888188:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 191 00000020:00080000:3.0:1783349839.888194:0:6605:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1783349839.890067:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.890085:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.890101:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.890108:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349839.890114:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.890123:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.890143:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:3.0:1783349839.890147:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349839.890151:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.890158:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.891228:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.892033:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655261696 00000100:00100000:3.0:1783349839.892049:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655261696 00000100:00100000:3.0:1783349839.892122:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 192 00000100:00100000:3.0:1783349839.892135:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:11025:x1869977655261696:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349839.892169:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349839.892203:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476f38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc76 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.892273:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc76 expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.892308:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc76 expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.892333:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:3.0:1783349839.892336:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349839.892340:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003a00, rc 0) 00000100:00100000:3.0:1783349839.892430:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11025:x1869977655261696:12345-192.168.204.36@tcp:101:bash.0 Request processed in 297us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349839.892438:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 192 00000100:00100000:1.0:1783349839.896114:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.896343:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655261824 00000100:00100000:0.0:1783349839.896360:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655261824 00000100:00100000:0.0:1783349839.896440:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:0.0:1783349839.896453:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:11025:x1869977655261824:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349839.896479:0:7807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349839.896507:0:7807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc7d expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349839.896549:0:7807:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4bc24d, atime: 0x6a4bc24c, ctime: 0x6a4bc24d, blocks: 0xb 00010000:00010000:0.0:1783349839.896583:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=226s v=(0 0) 00010000:00010000:0.0:1783349839.896589:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349839.896601:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 8 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.896621:0:7807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 8 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.896639:0:7807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6a00, rc 0) 00000100:00100000:0.0:1783349839.896973:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:11025:x1869977655261824:12345-192.168.204.36@tcp:101:bash.0 Request processed in 522us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349839.896982:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:0.0:1783349839.900492:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.900580:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655261952 00000100:00100000:3.0:1783349839.900594:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655261952 00002000:00010000:3.0:1783349839.901032:0:6585:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1783349839.901040:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320fb4d3100 with x1869977655261952 ext(0->18446744073709551615) 00002000:00010000:3.0:1783349839.901057:0:6585:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320fb4d3100. 00000100:00100000:3.0:1783349839.901145:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349839.901158:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2360:x1869977655261952:12345-192.168.204.36@tcp:10:bash.0 00002000:00010000:3.0:1783349839.901535:0:6585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783349839.901540:0:6585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783349837 -> 1783349838 00002000:00010000:3.0:1783349839.901543:0:6585:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783349836 -> 1783349836 00002000:00010000:3.0:1783349839.901546:0:6585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783349837 -> 1783349838 00002000:00010000:3.0:1783349839.901548:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783349839.901632:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2360:x1869977655261952:12345-192.168.204.36@tcp:10:bash.0 Request processed in 476us (1155us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783349839.901647:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00002000:00010000:3.0:1783349839.901652:0:6585:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1783349839.901670:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320fb4d3100 with x1869977655261952 ext(0->18446744073709551615) 00002000:00010000:3.0:1783349839.901676:0:6585:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320fb4d3100. 00000100:00100000:0.0:1783349839.957358:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.957516:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655262080 00000100:00100000:1.0:1783349839.957530:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655262080 00000100:00100000:1.0:1783349839.957678:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:1.0:1783349839.957690:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c725b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11503:x1869977655262080:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:1.0:1783349839.957844:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.957867:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.957884:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.957901:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.957910:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.957917:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958357:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958370:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958379:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349839.958432:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958446:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958460:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958468:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958475:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.958479:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958488:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958502:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349839.958505:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.958511:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958518:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48476f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958534:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958540:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958546:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958551:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacac00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.958560:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958567:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958575:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103000) 00010000:00010000:1.0:1783349839.958578:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.958581:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958588:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacac00/0x68b4a22a48476f4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958611:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958618:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958624:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958630:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.958634:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958640:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958649:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:1.0:1783349839.958651:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349839.958660:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.958666:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48476f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.958760:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c725b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11503:x1869977655262080:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 1069us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.958770:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 193 00000100:00100000:1.0:1783349839.984689:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349839.984849:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655262336 00000100:00100000:0.0:1783349839.984865:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655262336 00000100:00100000:0.0:1783349839.984946:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:0.0:1783349839.984961:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+32:11507:x1869977655262336:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349839.984992:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349839.985057:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476f5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc84 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985196:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985216:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985233:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985254:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985263:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985270:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985706:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985718:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985725:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349839.985738:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783349839.985895:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985916:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985924:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985931:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349839.985936:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985944:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985960:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:0.0:1783349839.985963:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349839.985970:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985978:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a48476f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.985996:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986003:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986010:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986016:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349839.986038:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986046:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986055:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c2913200) 00010000:00010000:0.0:1783349839.986058:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349839.986061:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986068:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a48476f69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986125:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a48476f5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc84 expref: 35 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986142:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc84 expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349839.986150:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:0.0:1783349839.986153:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783349839.986156:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6800, rc 0) 00000100:00100000:0.0:1783349839.986290:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fadebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:11507:x1869977655262336:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1332us (1614us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1783349839.986299:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 194 00000100:00100000:0.0:1783349839.990163:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.990617:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655262464 00000100:00100000:3.0:1783349839.990633:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655262464 00000100:00100000:3.0:1783349839.990775:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:3.0:1783349839.990788:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+34:11507:x1869977655262464:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1783349839.990933:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.990956:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.990968:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.991015:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.991043:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 34 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.991065:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666780416:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349839.991240:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349839.993958:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6605:1869977666780416:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349839.994128:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349839.994937:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349839.995096:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655262720 00000100:00100000:1.0:1783349839.995107:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655262720 00000100:00100000:1.0:1783349839.995180:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:1.0:1783349839.995191:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:5566:x1869977655262720:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1783349839.995735:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:1.0:1783349839.995917:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:5566:x1869977655262720:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 725us (983us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783349839.995926:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00000020:00080000:1.0:1783349839.995932:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783349839.998335:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349839.998412:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655262848 00000100:00100000:3.0:1783349839.998443:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655262848 00010000:00010000:3.0:1783349839.998500:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 37 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349839.998551:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:3.0:1783349839.998561:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c78ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:2361:x1869977655262848:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349839.998581:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349839.998588:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 37 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.998614:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 37 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.998642:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48476f23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc6f expref: 37 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.998672:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:3.0:1783349839.998678:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.998689:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.998699:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349839.998735:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349839.998854:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c78ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:2361:x1869977655262848:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 293us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349839.998883:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 75 00010000:00010000:1.0:1783349839.999238:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999247:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999289:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999297:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999313:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999321:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349839.999327:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999336:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999347:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:1.0:1783349839.999351:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349839.999355:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349839.999361:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48476f7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349839.999474:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:11507:x1869977655262464:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 8689us (9328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349839.999484:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 195 00000100:00100000:1.0:1783349840.002204:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.002288:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655263104 00000100:00100000:3.0:1783349840.002301:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655263104 00000100:00100000:3.0:1783349840.002469:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:3.0:1783349840.002480:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+35:11507:x1869977655263104:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1783349840.002858:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:11507:x1869977655263104:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 379us (667us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1783349840.002867:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00080000:2.0:1783349840.004703:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349840.051952:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.052164:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655263360 00000100:00100000:3.0:1783349840.052183:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655263360 00000100:00100000:3.0:1783349840.052278:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:3.0:1783349840.052292:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+36:11518:x1869977655263360:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:3.0:1783349840.052332:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.052367:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc8b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.052683:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.052704:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.052717:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.052736:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.052766:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.052774:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.053842:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.053858:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.053867:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349840.053881:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783349840.054092:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054101:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054108:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054175:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349840.054181:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054190:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054218:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349840.054221:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349840.054229:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054235:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476f8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054254:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054261:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054267:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054273:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349840.054276:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054283:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054291:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320cf8b3200) 00010000:00010000:3.0:1783349840.054293:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349840.054296:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054303:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48476f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054453:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc8b expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054471:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc8b expref: 38 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.054479:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:3.0:1783349840.054481:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349840.054486:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003400, rc 0) 00000100:00100000:3.0:1783349840.054698:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:11518:x1869977655263360:12345-192.168.204.36@tcp:101:cat.0 Request processed in 2407us (2761us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783349840.054709:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 196 00000100:00100000:0.0:1783349840.060595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.060721:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655263616 00000100:00100000:3.0:1783349840.060735:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655263616 00000100:00100000:3.0:1783349840.060846:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:3.0:1783349840.060861:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:11518:x1869977655263616:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:3.0:1783349840.061778:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:11518:x1869977655263616:12345-192.168.204.36@tcp:35:cat.0 Request processed in 914us (1196us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783349840.061789:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:1.0:1783349840.082528:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.082835:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655263872 00000100:00100000:2.0:1783349840.082854:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655263872 00000100:00100000:2.0:1783349840.082934:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 197 00000100:00100000:2.0:1783349840.082948:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:11519:x1869977655263872:12345-192.168.204.36@tcp:36:rm.0 00010000:00010000:2.0:1783349840.083083:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783349840.083136:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48476f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc8b expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083162:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48476f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc84 expref: 38 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083419:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48476f38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc76 expref: 37 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083434:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320e0103900) 00010000:00010000:2.0:1783349840.083453:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349840.083487:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083504:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083528:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083546:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083554:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.083561:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.085528:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.085548:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.085561:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349840.086292:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:2.0:1783349840.086376:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.086388:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.086396:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.086403:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.086416:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.086423:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088747:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349840.088813:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088826:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088836:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088843:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.088848:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088857:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088877:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349840.088881:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783349840.088887:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088893:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48476fb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088919:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088941:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088947:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088953:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.088957:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088963:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088973:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349840.088987:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.088991:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.088998:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a48476fa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349840.089011:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044d46857 reply state 00000000dbaf9c4e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.089034:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349840.089170:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+38:11519:x1869977655263872:12345-192.168.204.36@tcp:36:rm.0 Request processed in 6219us (6652us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783349840.089181:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 197 00010000:00010000:3.0:1783349840.089691:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349840.089698:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.089704:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349840.089707:0:7481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.089721:0:7481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.089731:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349840.089733:0:7481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783349840.089735:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.089739:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48476fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.089753:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349840.089754:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349840.089755:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349840.091296:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.091332:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.091340:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.091346:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.091351:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.091359:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.091375:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c3886100) 00010000:00010000:2.0:1783349840.091378:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.091384:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.091391:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48476faf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.122099:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349840.122209:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655264128 00000100:00100000:0.0:1783349840.122224:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655264128 00000100:00100000:0.0:1783349840.122312:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 198 00000100:00100000:0.0:1783349840.122323:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+37:11525:x1869977655264128:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:0.0:1783349840.122363:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349840.122391:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476fc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc92 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.122724:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.122744:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.122759:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.122780:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.122787:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.122837:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349840.125203:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783349840.125585:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125607:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125630:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125673:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125679:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125684:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125688:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349840.125692:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125697:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125708:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:0.0:1783349840.125710:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349840.125713:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125718:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48476fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349840.125742:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b44ccca8 reply state 00000000ff1933bd transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349840.125752:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783349840.125858:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7000/0x68b4a22a48476fc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 40 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125872:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.125882:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:0.0:1783349840.125884:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349840.125886:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7800, rc 0) 00000100:00100000:0.0:1783349840.126000:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11525:x1869977655264128:12345-192.168.204.36@tcp:101:bash.0 Request processed in 3678us (3918us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783349840.126010:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 198 00010000:00010000:3.0:1783349840.128250:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.128269:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.128277:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.128284:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349840.128289:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.128298:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.128318:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c2913200) 00010000:00010000:3.0:1783349840.128343:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349840.128349:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.128356:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7600/0x68b4a22a48476fd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.129595:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.129758:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655264256 00000100:00100000:3.0:1783349840.129771:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655264256 00000100:00100000:3.0:1783349840.129981:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:3.0:1783349840.129993:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655264256:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349840.130027:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.130053:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bc99 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783349840.130087:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783349840.130317:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=227s v=(0 0) 00010000:00010000:3.0:1783349840.130323:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349840.130335:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 6 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.130358:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 6 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.130372:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002600, rc 0) 00000100:00100000:3.0:1783349840.133836:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655264256:12345-192.168.204.36@tcp:101:bash.0 Request processed in 3827us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.133851:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:0.0:1783349840.140379:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.140483:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655264384 00000100:00100000:3.0:1783349840.140508:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655264384 00000100:00100000:3.0:1783349840.140580:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:3.0:1783349840.140595:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:11525:x1869977655264384:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349840.140620:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.140646:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bca0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.140691:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 7 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.140701:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349840.140705:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783349840.140711:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.140752:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 7 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.140767:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 7 pid: 6580 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.140784:0:6579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6579:1869977666780544:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349840.141077:0:6579:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349840.144202:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.144489:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655264512 00000100:00100000:1.0:1783349840.144511:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655264512 00010000:00010000:1.0:1783349840.144564:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 8 pid: 6580 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.144640:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:1.0:1783349840.144651:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655264512:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349840.144671:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349840.144699:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 8 pid: 6580 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.144714:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 8 pid: 6580 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.144746:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349840.144751:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349840.144761:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.144773:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.144857:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.144876:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faca3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5771:1869977666780672:192.168.204.36@tcp:105: 00000100:00100000:1.0:1783349840.144990:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c69419c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783349840.145750:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a48476fe7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc99 expref: 8 pid: 6580 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.145838:0:6579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6579:1869977666780544:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349840.145873:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.145887:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002200, rc 0) 00000100:00100000:2.0:1783349840.146273:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:11525:x1869977655264384:12345-192.168.204.36@tcp:101:bash.0 Request processed in 5680us (5905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349840.146283:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:2.0:1783349840.149871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.150305:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655264768 00000100:00100000:3.0:1783349840.150322:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655264768 00000100:00100000:3.0:1783349840.150401:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:3.0:1783349840.150411:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+39:11525:x1869977655264768:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:3.0:1783349840.151000:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11525:x1869977655264768:12345-192.168.204.36@tcp:35:bash.0 Request processed in 588us (1142us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783349840.151008:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:1.0:1783349840.151494:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faca3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5771:1869977666780672:192.168.204.36@tcp:105: 00010000:00010000:1.0:1783349840.151544:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349840.151578:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2361:x1869977655264512:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 6928us (7393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.151587:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:1.0:1783349840.276101:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.276340:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655264896 00000100:00100000:3.0:1783349840.276355:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655264896 00000100:00100000:3.0:1783349840.276445:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:3.0:1783349840.276456:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+40:11541:x1869977655264896:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349840.276487:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.276515:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476ff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bca7 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.276608:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476ffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.276625:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.276655:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349840.276732:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783349840.276736:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349840.276763:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.276814:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48476ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca7 expref: 42 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.276835:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca7 expref: 41 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.276845:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349840.276848:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349840.276851:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002400, rc 0) 00000100:00100000:3.0:1783349840.276926:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:11541:x1869977655264896:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 471us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.276932:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 199 00000100:00100000:0.0:1783349840.281655:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.281776:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655265152 00000100:00100000:3.0:1783349840.281788:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655265152 00000100:00100000:3.0:1783349840.282072:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:3.0:1783349840.282085:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+41:11541:x1869977655265152:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349840.282113:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.282143:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcae expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.282321:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847700a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.282337:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847700a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.282349:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847700a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349840.282360:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783349840.282545:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcae expref: 44 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.282568:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847700a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcae expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.282578:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349840.282582:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349840.282586:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003400, rc 0) 00000100:00100000:3.0:1783349840.282670:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:11541:x1869977655265152:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 587us (1032us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1783349840.282679:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 200 00000100:00100000:0.0:1783349840.288680:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349840.288730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.288920:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655265536 00000100:00100000:1.0:1783349840.288937:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655265536 00000100:00100000:3.0:1783349840.289037:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655265408 00000100:00100000:3.0:1783349840.289043:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655265408 00000100:00100000:1.0:1783349840.289052:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:1.0:1783349840.289071:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:2359:x1869977655265536:12345-192.168.204.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783349840.289099:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 201 00010000:00010000:1.0:1783349840.289105:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783349840.289113:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:11541:x1869977655265408:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349840.289143:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a4847700a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcae expref: 44 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.289170:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:1.0:1783349840.289177:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349840.289256:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+43:2359:x1869977655265536:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 191us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.289266:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00010000:00010000:3.0:1783349840.289372:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.289411:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcb5 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.289539:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847701f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.289558:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847701f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.289570:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847701f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349840.289585:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783349840.289766:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcb5 expref: 45 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.289784:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847701f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcb5 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.290943:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349840.290947:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783349840.290949:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002000, rc 0) 00000100:00100000:3.0:1783349840.291049:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:11541:x1869977655265408:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1936us (2381us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1783349840.291058:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 201 00000100:00100000:0.0:1783349840.296743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.296869:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655265664 00000100:00100000:2.0:1783349840.296886:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655265664 00000100:00100000:2.0:1783349840.296983:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:2.0:1783349840.296996:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+6:2362:x1869977655265664:12345-192.168.204.36@tcp:1:lfs.0 00010000:00010000:2.0:1783349840.297103:0:7807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.297136:0:7807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.297147:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349840.297152:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349840.297158:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.297224:0:7807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 6 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.297245:0:7807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 6 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.297282:0:7807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7807:1869977666780800:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349840.297451:0:7807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349840.301062:0:7807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7807:1869977666780800:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349840.301232:0:7807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349840.304608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.304718:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655265792 00000100:00100000:2.0:1783349840.304731:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655265792 00002000:00100000:2.0:1783349840.304817:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9320faba0700 x1869977655265792/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:591/0 lens 504/0 e 0 to 0 dl 1783349851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349840.304842:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320faba0700 with x1869977655265792 ext(0->8) 00010000:00010000:2.0:1783349840.304852:0:6586:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 7 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.304870:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 7 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349840.304879:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320faba0700 00000100:00100000:2.0:1783349840.304922:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:2.0:1783349840.304932:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655265792:12345-192.168.204.36@tcp:4:lfs.0 00000100:00100000:2.0:1783349840.305745:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2362:x1869977655265792:12345-192.168.204.36@tcp:4:lfs.0 Request processed in 805us (1144us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783349840.305760:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00002000:00100000:2.0:1783349840.305774:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9320faba0700 x1869977655265792/t4294967308(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:591/0 lens 504/448 e 0 to 0 dl 1783349851 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783349840.305785:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320faba0700 with x1869977655265792 ext(0->8) 00010000:00010000:2.0:1783349840.305829:0:6586:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 9 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.305846:0:6586:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 9 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349840.305853:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9320faba0700 00000100:00100000:1.0:1783349840.310840:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.311096:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655265920 00000100:00100000:3.0:1783349840.311111:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655265920 00010000:00010000:3.0:1783349840.311166:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 9 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.311243:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:3.0:1783349840.311253:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655265920:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349840.311275:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783349840.311300:0:5771:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783349840.311303:0:5771:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783349839 00002000:00010000:3.0:1783349840.311306:0:5771:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783349839 00002000:00010000:3.0:1783349840.311308:0:5771:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783349839 00010000:00010000:3.0:1783349840.311315:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 9 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.311330:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 9 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.311361:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003555b9ca/0x68b4a22a48476fee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca0 expref: 9 pid: 6579 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.311382:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349840.311387:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349840.311394:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.311405:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.311445:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349840.311523:0:7807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311544:0:7807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311580:0:7807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311590:0:7807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311599:0:7807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311608:0:7807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc1720d40) 00000100:00100000:3.0:1783349840.311611:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655265920:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 356us (817us total) trans 0 rc 0/0 00010000:00010000:2.0:1783349840.311615:0:7807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.311625:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00010000:00010000:2.0:1783349840.311630:0:7807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311647:0:7807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.311656:0:7807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6b9738/0x68b4a22a4847702d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.311734:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655265664:12345-192.168.204.36@tcp:1:lfs.0 Request processed in 14740us (15007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349840.311746:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:0.0:1783349840.314615:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.315764:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655266176 00000100:00100000:2.0:1783349840.315781:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655266176 00000100:00100000:2.0:1783349840.315872:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1783349840.315886:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+44:11541:x1869977655266176:12345-192.168.204.36@tcp:35:lfs.0 00000004:00010000:2.0:1783349840.315984:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847701f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcb5 expref: 44 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349840.316403:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1783349840.316451:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1783349840.316961:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1783349840.317033:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.317052:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.317062:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.317106:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 48 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.317126:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 48 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.317159:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5787:1869977666780928:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349840.317278:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349840.320508:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.321206:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655266304 00000100:00100000:1.0:1783349840.321222:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655266304 00010000:00010000:1.0:1783349840.321284:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 49 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.321354:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:1.0:1783349840.321369:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:2361:x1869977655266304:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349840.321412:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349840.321420:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 49 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.321437:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 49 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.321464:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:1.0:1783349840.321470:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.321481:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.321490:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.321514:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349840.321599:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+49:2361:x1869977655266304:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 233us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.321608:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 78 00010000:00010000:2.0:1783349840.321844:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7800/0x68b4a22a48476fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc92 expref: 48 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.321866:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5787:1869977666780928:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349840.321902:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.321913:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.321920:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349840.322116:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1783349840.322430:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1783349840.322574:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5787:1869977666781056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783349840.322641:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349840.322897:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349840.322974:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666781056 00000100:00100000:1.0:1783349840.322983:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666781056 00000100:00100000:1.0:1783349840.323070:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349840.323080:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1869977666781056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783349840.323180:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1869977666781056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.323188:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783349840.323277:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5787:1869977666781056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783349840.323856:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1783349840.323932:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5787:1869977666781184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783349840.323979:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349840.324548:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b37240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349840.325941:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666781184 00000100:00100000:2.0:1783349840.325959:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666781184 00000100:00100000:2.0:1783349840.326051:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349840.326063:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1869977666781184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783349840.326476:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5787:x1869977666781184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 416us (2496us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783349840.326507:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783349840.326662:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5787:1869977666781184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783349840.326764:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1783349840.326863:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.326876:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.326886:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.326895:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349840.326902:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.326913:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.326935:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349840.326938:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783349840.326944:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.326958:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477034 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783349840.327482:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783349840.327618:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1783349840.327634:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 227389840981ns, next at 228389836556ns, rc = 0 00000001:00080000:3.0:1783349840.327642:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1783349840.327684:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349840.327688:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783349840.327696:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847701f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcb5 expref: 52 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.328317:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:11541:x1869977655266176:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 12429us (13711us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1783349840.328330:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000020:00080000:3.0:1783349840.328337:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783349840.331497:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.331620:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655266432 00000100:00100000:3.0:1783349840.331633:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655266432 00000100:00100000:3.0:1783349840.331766:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:3.0:1783349840.331779:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+51:11541:x1869977655266432:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349840.331848:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.331884:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a4847703b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcbc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.331974:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a4847703b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcbc expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.332036:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a4847703b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcbc expref: 52 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.332061:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349840.332065:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349840.332071:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002200, rc 0) 00000100:00100000:3.0:1783349840.332154:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:11541:x1869977655266432:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 378us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.332162:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 202 00000100:00100000:0.0:1783349840.336274:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.336606:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655266688 00000100:00100000:3.0:1783349840.336628:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655266688 00000100:00100000:3.0:1783349840.337304:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:3.0:1783349840.337321:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+52:11541:x1869977655266688:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1783349840.338580:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:11541:x1869977655266688:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 1252us (2311us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1783349840.338595:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:0.0:1783349840.406092:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.407313:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655266816 00000100:00100000:2.0:1783349840.407332:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655266816 00000100:00100000:2.0:1783349840.407441:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:2.0:1783349840.407453:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:11551:x1869977655266816:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:2.0:1783349840.407575:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407599:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407615:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407632:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407639:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407647:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407789:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407829:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407837:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349840.407928:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407945:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407952:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407960:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407966:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.407971:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407980:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.407995:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349840.407998:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.408004:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408020:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408037:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408044:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408056:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408062:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.408065:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408072:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408080:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320c3886100) 00010000:00010000:2.0:1783349840.408083:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.408086:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408092:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408109:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408233:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408240:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408245:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.408249:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408267:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408276:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:2.0:1783349840.408278:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.408282:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.408288:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96e00/0x68b4a22a48477050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.408880:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:11551:x1869977655266816:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 1422us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349840.408896:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 203 00000100:00100000:0.0:1783349840.446242:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.446386:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655267072 00000100:00100000:1.0:1783349840.446402:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655267072 00000100:00100000:1.0:1783349840.446528:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:1.0:1783349840.446540:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+53:11554:x1869977655267072:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349840.446568:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349840.446595:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48477057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcc3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446699:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446717:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446731:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446750:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446758:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446765:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446984:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.446994:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447026:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349840.447037:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783349840.447871:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447885:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447892:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447898:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349840.447904:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447912:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447929:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349840.447932:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349840.447938:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447945:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a4847705e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447962:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447969:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447982:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447987:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349840.447990:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.447996:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.448004:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103000) 00010000:00010000:1.0:1783349840.448007:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349840.448019:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.448026:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a48477065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.448094:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a48477057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.448157:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.448165:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349840.448167:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349840.448170:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca000, rc 0) 00000100:00100000:1.0:1783349840.448263:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11554:x1869977655267072:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1724us (2037us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1783349840.448280:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 204 00000100:00100000:0.0:1783349840.453402:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.453756:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655267200 00000100:00100000:3.0:1783349840.453934:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655267200 00000100:00100000:3.0:1783349840.454204:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:3.0:1783349840.454219:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11554:x1869977655267200:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:3.0:1783349840.454321:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454346:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454382:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454419:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454426:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454435:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454442:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349840.454448:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454456:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454472:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349840.454475:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349840.454481:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.454487:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a4847707a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.454592:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11554:x1869977655267200:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 376us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.454601:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 205 00000100:00100000:0.0:1783349840.456609:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.456702:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655267456 00000100:00100000:2.0:1783349840.456716:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655267456 00000100:00100000:2.0:1783349840.456827:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:2.0:1783349840.456841:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+55:11554:x1869977655267456:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1783349840.457211:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11554:x1869977655267456:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 373us (613us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1783349840.457219:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00000040:00080000:1.0:1783349840.490983:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349840.490996:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349840.492305:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783349840.492321:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349840.512549:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.512967:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655267712 00000100:00100000:3.0:1783349840.512999:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655267712 00000100:00100000:3.0:1783349840.513084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 206 00000100:00100000:3.0:1783349840.513096:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11564:x1869977655267712:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349840.513355:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.513360:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783349840.513395:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a48476ffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bca7 expref: 56 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.513418:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349840.513423:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349840.513439:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477081 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.513565:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.513581:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.513592:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.513636:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.513651:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 56 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.513667:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666781312:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349840.513928:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b37480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349840.519576:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666781312:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349840.519628:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349840.520620:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.520855:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655267840 00000100:00100000:3.0:1783349840.520866:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655267840 00010000:00010000:3.0:1783349840.520931:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 57 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.521292:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:3.0:1783349840.521304:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+57:2362:x1869977655267840:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349840.521326:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349840.521335:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 57 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.521351:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 57 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.521378:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847706c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcc3 expref: 57 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.521400:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349840.521406:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.521418:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.521441:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.521673:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349840.521764:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:2362:x1869977655267840:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 460us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.521773:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 79 00010000:00010000:0.0:1783349840.522141:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.522151:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349840.522173:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783349840.522374:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477081 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.522395:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349840.522404:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:0.0:1783349840.522407:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783349840.522410:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002600, rc 0) 00000100:00100000:0.0:1783349840.522474:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11564:x1869977655267712:12345-192.168.204.36@tcp:101:bash.0 Request processed in 9381us (9937us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1783349840.522483:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 206 00000100:00100000:0.0:1783349840.527225:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.527300:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655268096 00000100:00100000:2.0:1783349840.527315:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655268096 00000100:00100000:2.0:1783349840.527393:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 207 00000100:00100000:2.0:1783349840.527475:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+56:11564:x1869977655268096:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:2.0:1783349840.527873:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.527921:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.527936:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349840.528001:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1783349840.528042:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000badb162f reply state 000000005e4b1b35 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349840.528054:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349840.528190:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11564:x1869977655268096:12345-192.168.204.36@tcp:36:bash.0 Request processed in 785us (976us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1783349840.528199:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 207 00000020:00080000:2.0:1783349840.528205:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349840.530079:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.530158:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.530166:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.530175:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349840.530181:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.530190:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.530211:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349840.530215:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349840.530220:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.530226:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96200/0x68b4a22a48477096 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349840.534594:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.535100:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655268224 00000100:00100000:1.0:1783349840.535244:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655268224 00000100:00100000:1.0:1783349840.535335:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 208 00000100:00100000:1.0:1783349840.535347:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11564:x1869977655268224:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349840.535380:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349840.535410:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847709d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcd1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.535550:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.535564:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.535572:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.535608:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.536023:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 59 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.536068:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5784:1869977666781440:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349840.536328:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c69419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349840.539314:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.540124:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655268352 00000100:00100000:3.0:1783349840.540200:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655268352 00010000:00010000:3.0:1783349840.540258:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 60 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.540315:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:3.0:1783349840.540327:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:2361:x1869977655268352:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349840.540347:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349840.540356:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 60 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.540372:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 60 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.540398:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349840.540404:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.540416:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.540424:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.540446:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349840.540530:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:2361:x1869977655268352:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 205us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.540539:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 80 00010000:00010000:1.0:1783349840.541057:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a48477088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcca expref: 59 pid: 5785 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.541078:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5784:1869977666781440:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349840.541105:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.541114:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.541120:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349840.541179:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783349840.541183:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349840.541211:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.541247:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a4847709d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 59 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.541261:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.541269:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349840.541281:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349840.541284:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349840.541373:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11564:x1869977655268224:12345-192.168.204.36@tcp:101:bash.0 Request processed in 6029us (6793us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.541381:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 208 00000100:00100000:2.0:1783349840.546677:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.546744:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655268608 00000100:00100000:3.0:1783349840.546758:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655268608 00000100:00100000:3.0:1783349840.546852:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:3.0:1783349840.546864:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+58:11564:x1869977655268608:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:2.0:1783349840.547677:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11564:x1869977655268608:12345-192.168.204.36@tcp:35:bash.0 Request processed in 812us (1009us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783349840.547685:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00010000:00010000:3.0:1783349840.554366:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349840.595663:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.595742:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655268736 00000100:00100000:3.0:1783349840.595758:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655268736 00000100:00100000:3.0:1783349840.595880:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00100000:3.0:1783349840.595892:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+59:11570:x1869977655268736:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349840.595931:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.595967:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a484770ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcd8 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.596117:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484770b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.596135:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484770b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.596150:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484770b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349840.596234:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783349840.596238:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349840.596266:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484770b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.596297:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a484770ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd8 expref: 61 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.596338:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484770b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd8 expref: 60 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.596348:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349840.596352:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349840.596356:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003a00, rc 0) 00000100:00100000:3.0:1783349840.596433:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11570:x1869977655268736:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 543us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.596442:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 209 00000100:00100000:0.0:1783349840.600189:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.600358:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655268864 00000100:00100000:3.0:1783349840.600381:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655268864 00000100:00100000:3.0:1783349840.600456:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 210 00000100:00100000:3.0:1783349840.600466:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11570:x1869977655268864:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349840.600492:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.600519:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484770b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcdf expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.600601:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.600618:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.600630:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.600646:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.600671:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.600680:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603200:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603230:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603243:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349840.603310:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783349840.603330:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349840.603356:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603368:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603380:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603387:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603393:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603399:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.603404:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603411:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603428:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:2.0:1783349840.603431:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.603436:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603443:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a484770c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603461:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603477:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603483:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603488:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349840.603491:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603498:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603506:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320cf8b3600) 00010000:00010000:2.0:1783349840.603509:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349840.603512:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.603518:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a484770c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.604056:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002600/0x68b4a22a484770b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcdf expref: 62 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.604075:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcdf expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.604082:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:2.0:1783349840.604084:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349840.604094:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349840.604164:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11570:x1869977655268864:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3698us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349840.604174:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 210 00000100:00100000:2.0:1783349840.609110:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349840.609176:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.609239:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655269248 00000100:00100000:1.0:1783349840.609253:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655269248 00000100:00100000:1.0:1783349840.609352:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:1.0:1783349840.609366:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c78ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:2361:x1869977655269248:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349840.609389:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783349840.609405:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655269120 00000100:00100000:3.0:1783349840.609410:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655269120 00010000:00010000:1.0:1783349840.609424:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a484770ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcdf expref: 62 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.609450:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 211 00010000:00010000:1.0:1783349840.609451:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00000100:00100000:3.0:1783349840.609458:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11570:x1869977655269120:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349840.609458:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349840.609479:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349840.609499:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a484770d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bce6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.609529:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c78ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:2361:x1869977655269248:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 167us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.609536:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00010000:00010000:3.0:1783349840.609644:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.609661:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.609672:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.609725:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.609745:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 61 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349840.609822:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666781568:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349840.609919:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7b37480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349840.613341:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666781568:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349840.613387:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349840.616422:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.616538:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655269376 00000100:00100000:1.0:1783349840.616553:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655269376 00010000:00010000:1.0:1783349840.616625:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 62 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349840.616675:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:1.0:1783349840.616687:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:2362:x1869977655269376:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349840.617172:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349840.617182:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 62 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.617214:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 62 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.617246:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd1 expref: 62 pid: 5784 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.617266:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349840.617273:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.617285:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.617293:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.617385:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349840.617480:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:2362:x1869977655269376:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 794us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.617496:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00010000:00010000:3.0:1783349840.618174:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349840.618187:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349840.618212:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783349840.618763:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a484770d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.618786:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.618891:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:2.0:1783349840.618894:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349840.618898:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030600, rc 0) 00000100:00100000:2.0:1783349840.619003:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11570:x1869977655269120:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9545us (9909us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1783349840.619021:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 211 00000100:00100000:0.0:1783349840.624284:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.624356:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655269632 00000100:00100000:1.0:1783349840.624375:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655269632 00000100:00100000:1.0:1783349840.624595:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:1.0:1783349840.624607:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11570:x1869977655269632:12345-192.168.204.36@tcp:103:lfs.0 00010000:00010000:1.0:1783349840.624628:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349840.624659:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a4847703b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcbc expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.624705:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349840.624711:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349840.624932:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11570:x1869977655269632:12345-192.168.204.36@tcp:103:lfs.0 Request processed in 326us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.624941:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:0.0:1783349840.627290:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349840.627559:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655269760 00000100:00100000:1.0:1783349840.627574:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655269760 00000100:00100000:1.0:1783349840.627688:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 212 00000100:00100000:1.0:1783349840.627701:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11570:x1869977655269760:12345-192.168.204.36@tcp:58:lfs.0 00010000:00010000:1.0:1783349840.627863:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.627885:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349840.627899:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349840.628159:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1783349840.628265:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11570:x1869977655269760:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 567us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.628272:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 212 00000100:00100000:2.0:1783349840.630777:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349840.631117:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655269888 00000100:00100000:3.0:1783349840.631131:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655269888 00000100:00100000:2.0:1783349840.631229:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:2.0:1783349840.631242:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+60:11570:x1869977655269888:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349840.631269:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349840.631294:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bced expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.631369:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.631402:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.631427:0:5786:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.631444:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.631462:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:2.0:1783349840.631464:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349840.631467:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349840.631473:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97000, rc 0) 00000100:00100000:2.0:1783349840.631537:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11570:x1869977655269888:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 300us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349840.631542:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 213 00000100:00100000:0.0:1783349840.748301:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349840.748568:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666781824:0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.748672:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349840.748756:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349840.748763:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666781952:0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.748830:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349840.748875:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666781824 00000100:00100000:1.0:1783349840.748884:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666781824 00000100:00100000:1.0:1783349840.748934:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666781952 00000100:00100000:1.0:1783349840.748937:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666781952 00000100:00080000:1.0:1783349840.748964:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349840.748992:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349840.749002:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666781824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.749079:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666781824:12345-0@lo:400:kworker.0 Request processed in 78us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.749087:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783349840.749147:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666781824:0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.749180:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783349840.749186:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666781952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.749219:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666781952:12345-0@lo:400:kworker.0 Request processed in 34us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349840.749226:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783349840.749249:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666781952:0@lo:400:kworker.0 00000100:00100000:0.0:1783349840.749427:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666782080:0@lo:400:kworker.0 00000100:00100000:0.0:1783349840.749563:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349840.749603:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666781696:0@lo:400:kworker.0 00000100:00100000:3.0:1783349840.749614:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666782080 00000100:00100000:3.0:1783349840.749620:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666782080 00000100:00100000:0.0:1783349840.749630:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349840.749669:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666781696 00000100:00100000:3.0:1783349840.749672:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349840.749674:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666781696 00000100:00100000:3.0:1783349840.749685:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1869977666782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349840.749704:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783349840.749711:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666781696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.749822:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666782208:0@lo:400:kworker.0 00000100:00100000:3.0:1783349840.749910:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1869977666782080:12345-0@lo:400:kworker.0 Request processed in 227us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349840.749919:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349840.749925:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666781696:12345-0@lo:400:kworker.0 Request processed in 212us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349840.749934:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1783349840.749955:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666782080:0@lo:400:kworker.0 00000100:00100000:3.0:1783349840.749968:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666781696:0@lo:400:kworker.0 00000100:00100000:1.0:1783349840.750164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349840.750261:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666782208 00000100:00100000:2.0:1783349840.750266:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666782208 00000100:00100000:2.0:1783349840.750404:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783349840.750413:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666782208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349840.750468:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1869977666782208:12345-0@lo:400:kworker.0 Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349840.750475:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783349840.750589:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1869977666782208:0@lo:400:kworker.0 00000100:00080000:1.0:1783349840.750632:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349841.258153:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320f78dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666782336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349841.258270:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349841.258728:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666782336 00000100:00100000:2.0:1783349841.258756:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666782336 00000100:00100000:2.0:1783349841.258928:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783349841.258941:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666782336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349841.258971:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783349841.260043:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349841.260088:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666782336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1147us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.260100:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783349841.260911:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320f78dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666782336:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1783349841.514415:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349841.514428:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349841.514474:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1783349841.514502:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349841.514683:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c67e4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666782464:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349841.514873:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6941600 going to sleep for 11 seconds 00000100:00100000:1.0:1783349841.519448:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c67e4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666782464:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783349841.519782:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.520531:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655270016 00000100:00100000:3.0:1783349841.520562:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655270016 00000100:00100000:3.0:1783349841.520656:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:3.0:1783349841.520669:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11571:x1869977655270016:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349841.520735:0:6605:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783349841.521102:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11571:x1869977655270016:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 425us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.521112:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 214 00000100:00100000:2.0:1783349841.524121:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.524188:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655270144 00000100:00100000:1.0:1783349841.524201:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655270144 00000100:00100000:1.0:1783349841.524287:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:1.0:1783349841.524301:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11571:x1869977655270144:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783349841.524402:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524424:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524440:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524458:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524467:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524474:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524508:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524526:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524553:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349841.524607:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783349841.524611:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349841.524626:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524636:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524641:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524646:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524650:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349841.524654:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524669:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524681:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:1.0:1783349841.524683:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349841.524687:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524691:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca600/0x68b4a22a484770f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524710:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524714:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524718:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524721:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349841.524722:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524726:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524729:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9320e0103000) 00010000:00010000:1.0:1783349841.524731:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349841.524732:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524735:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb000/0x68b4a22a484770ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524752:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524755:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524759:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524765:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349841.524767:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524771:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524774:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349841.524776:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349841.524778:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.524781:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.525327:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11571:x1869977655270144:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 1024us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.525341:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 215 00000100:00100000:0.0:1783349841.529125:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.529205:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655270400 00000100:00100000:2.0:1783349841.529219:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655270400 00000100:00100000:2.0:1783349841.529355:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:2.0:1783349841.529368:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+61:11571:x1869977655270400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349841.529398:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349841.529446:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a4847710d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcf4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529595:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529615:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529631:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349841.529645:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783349841.529866:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529876:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529900:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529907:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349841.529913:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529922:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529950:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:2.0:1783349841.529954:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783349841.529961:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.529968:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.530039:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a4847710d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcf4 expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.530051:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:2.0:1783349841.530054:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349841.530059:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a4847710d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcf4 expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.530070:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96800, rc 0) 00000100:00100000:2.0:1783349841.530176:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11571:x1869977655270400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 811us (1082us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1783349841.530199:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 216 00000100:00100000:2.0:1783349841.535351:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.535713:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655270528 00000100:00100000:3.0:1783349841.535726:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655270528 00000100:00100000:1.0:1783349841.535888:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:1.0:1783349841.535902:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11571:x1869977655270528:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783349841.536140:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783349841.536339:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11571:x1869977655270528:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 440us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.536348:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 217 00000100:00100000:0.0:1783349841.541596:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.541724:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655270784 00000100:00100000:3.0:1783349841.541740:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655270784 00000100:00100000:3.0:1783349841.542115:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:3.0:1783349841.542128:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11571:x1869977655270784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349841.542163:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349841.542169:0:6605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783349841.542210:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a484770b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcd8 expref: 62 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.542236:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349841.542243:0:6605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349841.542260:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031800/0x68b4a22a48477122 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bcfb expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783349841.543053:0:6605:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1783349841.543352:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.543370:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.543762:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.543897:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031800/0x68b4a22a48477122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcfb expref: 64 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.543923:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcfb expref: 63 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.543934:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886100) 00010000:00010000:2.0:1783349841.543937:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349841.543941:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96800, rc 0) 00000100:00100000:2.0:1783349841.544055:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11571:x1869977655270784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1928us (2555us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783349841.544065:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 218 00000100:00100000:0.0:1783349841.550108:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.550309:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655271040 00000100:00100000:3.0:1783349841.550325:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655271040 00000100:00100000:3.0:1783349841.550424:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 219 00000100:00100000:3.0:1783349841.550433:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11571:x1869977655271040:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783349841.550533:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349841.550563:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bcfb expref: 63 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550582:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886100) 00010000:00010000:3.0:1783349841.550592:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349841.550616:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550629:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550637:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550648:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550653:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550657:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550747:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550752:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550757:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550766:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0031c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349841.550771:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550777:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550782:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:3.0:1783349841.550784:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349841.550787:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550816:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031c00/0x68b4a22a48477137 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550827:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550831:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550836:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550839:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349841.550840:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550852:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550864:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9d51cc46 (ffff9320cf8b3e00) 00010000:00010000:3.0:1783349841.550866:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349841.550868:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.550872:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847713e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9d51cc46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.550961:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11571:x1869977655271040:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 529us (870us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783349841.550966:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 219 00000100:00100000:0.0:1783349841.553434:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.553534:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655271168 00000100:00100000:2.0:1783349841.553550:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655271168 00000100:00100000:2.0:1783349841.553632:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:2.0:1783349841.553641:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+62:11571:x1869977655271168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349841.553683:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349841.553712:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd02 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.553777:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.553823:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.553838:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.554047:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97600/0x68b4a22a48477145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 64 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.554068:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.554077:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349841.554080:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783349841.554084:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96000, rc 0) 00000100:00100000:2.0:1783349841.554196:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11571:x1869977655271168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 556us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.554203:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 220 00000100:00100000:0.0:1783349841.557578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.557663:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655271424 00000100:00100000:1.0:1783349841.557679:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655271424 00000100:00100000:1.0:1783349841.557828:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 221 00000100:00100000:1.0:1783349841.557841:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f78dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+63:11571:x1869977655271424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349841.557977:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.558009:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.558023:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349841.558345:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1783349841.558357:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 228620563331ns, next at 229620560601ns, rc = 0 00000004:00010000:1.0:1783349841.558518:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088c4a623 reply state 000000008c66ed55 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.558530:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349841.558644:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f78dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+65:11571:x1869977655271424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 804us (1080us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1783349841.558651:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 221 00010000:00010000:3.0:1783349841.562184:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.562207:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.562215:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.562221:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349841.562227:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.562236:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.562258:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349841.562262:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349841.562296:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.562305:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.562521:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.562975:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655271552 00000100:00100000:3.0:1783349841.562998:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655271552 00000100:00100000:3.0:1783349841.563200:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 222 00000100:00100000:3.0:1783349841.563212:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+64:11571:x1869977655271552:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349841.563246:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349841.563269:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd09 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.563346:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 65 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.563362:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 65 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.563383:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349841.563387:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349841.563390:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030e00, rc 0) 00000100:00100000:3.0:1783349841.563510:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+65:11571:x1869977655271552:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 299us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349841.563518:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 222 00000100:00100000:0.0:1783349841.566414:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.566512:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655271680 00000100:00100000:2.0:1783349841.566525:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655271680 00000100:00100000:2.0:1783349841.566611:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:2.0:1783349841.566625:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2362:x1869977655271680:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783349841.567102:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2362:x1869977655271680:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 471us (689us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783349841.567111:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00080000:3.0:1783349841.567192:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349841.569270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.569366:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655271936 00000100:00100000:1.0:1783349841.569376:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655271936 00000100:00100000:1.0:1783349841.569430:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1783349841.569439:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+65:11571:x1869977655271936:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783349841.569763:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+66:11571:x1869977655271936:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 325us (502us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783349841.569770:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:1.0:1783349841.572149:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.572885:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655272192 00000100:00100000:3.0:1783349841.572901:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655272192 00000100:00100000:0.0:1783349841.573084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:0.0:1783349841.573184:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+66:11571:x1869977655272192:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783349841.573341:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c67e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+66:11571:x1869977655272192:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 163us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.573351:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 223 00000100:00100000:0.0:1783349841.576213:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.576335:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655272320 00000100:00100000:2.0:1783349841.576347:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655272320 00000100:00100000:2.0:1783349841.576490:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:2.0:1783349841.576501:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+66:11571:x1869977655272320:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349841.576526:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349841.576549:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd10 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.576636:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48477168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.576653:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48477168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.576666:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48477168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349841.576712:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349841.576733:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48477168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.577644:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd10 expref: 68 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.577677:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48477168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd10 expref: 67 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.577713:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349841.577717:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783349841.577722:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00010000:00010000:3.0:1783349841.578036:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349841.578082:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+67:11571:x1869977655272320:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1581us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.578092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 224 00000100:00100000:2.0:1783349841.582627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.582889:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655272448 00000100:00100000:0.0:1783349841.582906:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655272448 00000100:00100000:0.0:1783349841.583034:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:0.0:1783349841.583048:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+10:2361:x1869977655272448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349841.583074:0:7807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349841.583109:0:7807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd17 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783349841.583146:0:7807:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc250, blocks: 0x1 00010000:00010000:0.0:1783349841.583175:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=228s v=(0 0) 00010000:00010000:0.0:1783349841.583181:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349841.583194:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 11 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.583215:0:7807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 11 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.583234:0:7807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6400, rc 0) 00000100:00100000:0.0:1783349841.583310:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:2361:x1869977655272448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 264us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.583319:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:1.0:1783349841.587247:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.587409:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655272704 00000100:00100000:2.0:1783349841.587423:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655272704 00000100:00100000:2.0:1783349841.587513:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:2.0:1783349841.587526:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+67:11571:x1869977655272704:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783349841.587711:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+67:11571:x1869977655272704:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 187us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.587721:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 225 00000100:00100000:1.0:1783349841.593572:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.594058:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655272832 00000100:00100000:3.0:1783349841.594072:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655272832 00000100:00100000:2.0:1783349841.594303:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:2.0:1783349841.594316:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:11571:x1869977655272832:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349841.594344:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349841.594369:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd1e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.594413:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 12 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.594424:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349841.594437:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349841.594444:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.594567:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 12 pid: 7807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.594584:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 12 pid: 7807 timeout: 328 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349841.594601:0:6580:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1869977666782592:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349841.595099:0:6580:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349841.601279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.601436:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655272960 00000100:00100000:0.0:1783349841.601450:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655272960 00010000:00010000:0.0:1783349841.601508:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 13 pid: 7807 timeout: 328 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.601572:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:0.0:1783349841.601584:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2362:x1869977655272960:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349841.601607:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349841.601638:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 13 pid: 7807 timeout: 328 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.601657:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 13 pid: 7807 timeout: 328 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.601694:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349841.601699:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349841.601709:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 13 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.601721:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 13 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.601767:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 13 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.601787:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5769:1869977666782720:192.168.204.36@tcp:105: 00000100:00100000:0.0:1783349841.601950:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d15cab40 going to sleep for 11 seconds 00010000:00010000:1.0:1783349841.603198:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075117407/0x68b4a22a4847716f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd17 expref: 13 pid: 7807 timeout: 328 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.603226:0:6580:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc590ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6580:1869977666782592:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349841.603273:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.603291:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97200, rc 0) 00000100:00100000:1.0:1783349841.603362:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:11571:x1869977655272832:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 9047us (9806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.603431:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:0.0:1783349841.606143:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5769:1869977666782720:192.168.204.36@tcp:105: 00010000:00010000:0.0:1783349841.606211:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349841.606287:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:2362:x1869977655272960:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 4702us (5022us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.606301:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:0.0:1783349841.607628:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.607748:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655273088 00000100:00100000:3.0:1783349841.607761:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655273088 00002000:00100000:3.0:1783349841.607974:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9320e40aaa00 x1869977655273088/t0(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:592/0 lens 504/0 e 0 to 0 dl 1783349852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783349841.607986:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320e40aaa00 with x1869977655273088 ext(0->12) 00002000:00010000:3.0:1783349841.608004:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320e40aaa00 00000100:00100000:1.0:1783349841.608113:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:1.0:1783349841.608130:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+11:2361:x1869977655273088:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783349841.609002:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2361:x1869977655273088:12345-192.168.204.36@tcp:4:lhsmtool_posix.0 Request processed in 864us (1372us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1783349841.609012:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00002000:00100000:1.0:1783349841.609022:0:6585:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9320e40aaa00 x1869977655273088/t4294967320(0) o4->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:592/0 lens 504/448 e 0 to 0 dl 1783349852 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349841.609031:0:6585:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320e40aaa00 with x1869977655273088 ext(0->12) 00002000:00010000:1.0:1783349841.609035:0:6585:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320e40aaa00 00000100:00100000:2.0:1783349841.617523:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.617771:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655273216 00000100:00100000:3.0:1783349841.617789:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655273216 00000100:00100000:2.0:1783349841.618337:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:2.0:1783349841.618360:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+67:11571:x1869977655273216:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783349841.658333:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967499 is committed 00000001:00080000:1.0:1783349841.658379:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1783349841.658388:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1783349841.658434:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1783349841.658538:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320c68536c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783349841.658544:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb6cef00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320c6853300 00000020:00080000:1.0:1783349841.658548:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320fb6ce800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9320fab8a400 00000004:00080000:1.0:1783349841.658564:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783349841.658582:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320c7b37a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783349841.658585:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320c5112000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320c7b37180 00000020:00080000:1.0:1783349841.658588:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320c5112700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9320c67cd400 00000020:00080000:1.0:1783349841.658656:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1783349841.658789:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666782848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783349841.658922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783349841.658937:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783349841.659205:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11571:x1869977655273216:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 40850us (41693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.659218:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 226 00000100:00100000:0.0:1783349841.659631:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666782848 00000100:00100000:0.0:1783349841.659642:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666782848 00000100:00100000:0.0:1783349841.659704:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349841.659715:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1869977666782848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783349841.659751:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1783349841.659823:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4bc24f, atime: 0x6a4bc24f, ctime: 0x6a4bc24f, blocks: 0x1 00010000:00010000:0.0:1783349841.659833:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.659856:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=228s v=(0 0) 00010000:00010000:0.0:1783349841.659861:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349841.659869:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.659889:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.659902:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.659912:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.659970:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783349841.660193:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666782976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783349841.660256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.660302:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349841.660308:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666783104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783349841.660329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.660361:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666782976 00000100:00100000:3.0:1783349841.660367:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666782976 00000100:00100000:0.0:1783349841.660623:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1869977666782848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 909us (1701us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783349841.660633:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783349841.660653:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666783104 00000100:00100000:0.0:1783349841.660656:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666783104 00000100:00100000:0.0:1783349841.660686:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783349841.660693:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3293:x1869977666783104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783349841.660905:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783349841.660909:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783349840 00002000:00010000:0.0:1783349841.660911:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783349841.660913:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783349840 -> 1783349840 00002000:00010000:0.0:1783349841.660916:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783349841.660953:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1869977666783104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 261us (622us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783349841.660961:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1783349841.660999:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349841.661007:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.661017:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349841.661022:0:7481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.661034:0:7481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.661070:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.661077:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000501469c2/0x68b4a22a4847717d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.661103:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349841.661105:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349841.661107:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783349841.661168:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320e40aa680/2, rc 0, transno 4294967321 00000100:00100000:0.0:1783349841.661177:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666783104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1783349841.661213:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320faaf7100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783349841.661220:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666782848:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1783349841.661471:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349841.662123:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783349841.662141:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3293:x1869977666782976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783349841.662178:0:7807:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1783349841.662205:0:7807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.662231:0:7807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 12 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.662240:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783349841.662255:0:7807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783349841.662261:0:7807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.662306:0:7807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 12 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.662323:0:7807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 12 pid: 7807 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.662341:0:7807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c6799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7807:1869977666783232:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349841.662505:0:7807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65300 going to sleep for 11 seconds 00000100:00100000:2.0:1783349841.670021:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.670118:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.670207:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655273472 00000100:00100000:3.0:1783349841.670212:0:7807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c6799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7807:1869977666783232:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349841.670218:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655273472 00010000:00010000:3.0:1783349841.670254:0:7807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.670271:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 13 pid: 7807 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.670316:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:0.0:1783349841.670329:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+13:2361:x1869977655273472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349841.670351:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349841.670357:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 13 pid: 7807 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.670398:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 13 pid: 7807 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.670427:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ef52f9/0x68b4a22a48476f3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc7d expref: 13 pid: 7807 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.670447:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349841.670452:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349841.670458:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.670470:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.670504:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349841.670580:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:2361:x1869977655273472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 253us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.670587:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:0.0:1783349841.670620:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655273344 00000100:00100000:0.0:1783349841.670623:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655273344 00000100:00100000:0.0:1783349841.670653:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:0.0:1783349841.670659:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+12:2359:x1869977655273344:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1783349841.670767:0:7807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.670779:0:7807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.670823:0:7807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.670833:0:7807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.670859:0:7807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349841.673487:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349841.673504:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.673520:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0031c00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349841.673536:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.673549:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.673581:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.673589:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061145fbe/0x68b4a22a48477184 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.673619:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349841.673621:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349841.673623:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349841.674231:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1869977666782976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12088us (13965us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1783349841.674246:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1783349841.674411:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320e40a8380/2, rc 0, transno 4294967322 00000100:00100000:1.0:1783349841.674424:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666782976:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1783349841.709383:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1783349841.709403:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1783349841.709410:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1783349841.709758:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2359:x1869977655273344:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 39091us (39748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.709783:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:2.0:1783349841.720495:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.720627:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655273728 00000100:00100000:1.0:1783349841.720640:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655273728 00000100:00100000:1.0:1783349841.720830:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 227 00000100:00100000:1.0:1783349841.720846:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11571:x1869977655273728:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783349841.720927:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349841.720975:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97e00/0x68b4a22a48477168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd10 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.721016:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:1.0:1783349841.721023:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349841.721067:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.721099:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.721111:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349841.722391:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033fae759 reply state 00000000f16f77fc transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.722411:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349841.722556:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:11571:x1869977655273728:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 1711us (2073us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1783349841.722566:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 227 00010000:00010000:2.0:1783349841.724160:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.724179:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.724187:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.724193:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349841.724295:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.724305:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.724327:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:2.0:1783349841.724331:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349841.724337:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.724344:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a4847718b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349841.728473:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.732468:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655273856 00000100:00100000:3.0:1783349841.732492:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655273856 00000100:00100000:3.0:1783349841.732673:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:3.0:1783349841.732687:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2360:x1869977655273856:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783349841.733031:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783349841.733036:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783349840 -> 1783349839 00002000:00010000:3.0:1783349841.733038:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783349839 00002000:00010000:3.0:1783349841.733041:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783349840 -> 1783349839 00002000:00010000:3.0:1783349841.733043:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783349841.733136:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2360:x1869977655273856:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 452us (4677us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1783349841.733146:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:3.0:1783349841.738010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.741418:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655274112 00000100:00100000:2.0:1783349841.741439:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655274112 00000100:00100000:3.0:1783349841.741895:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:3.0:1783349841.741909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:11571:x1869977655274112:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783349841.742027:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.742071:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.742083:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.742134:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.742150:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 20 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.742169:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb6c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666783360:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349841.742306:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349841.745432:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb6c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5786:1869977666783360:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349841.745474:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.750297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.753327:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655274240 00000100:00100000:0.0:1783349841.753351:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655274240 00010000:00010000:0.0:1783349841.753431:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 21 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.753594:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:0.0:1783349841.753605:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:2362:x1869977655274240:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349841.753625:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349841.753633:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 21 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.753649:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 21 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.753680:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96000/0x68b4a22a4847714c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd02 expref: 21 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.753705:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:0.0:1783349841.753710:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.753722:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.753731:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.753771:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349841.753886:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:2362:x1869977655274240:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 283us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.753893:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 84 00010000:00010000:1.0:1783349841.753957:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.753966:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754011:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754020:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754027:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754033:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349841.754038:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754056:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754066:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:1.0:1783349841.754068:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783349841.754072:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.754079:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030a00/0x68b4a22a48477192 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.754130:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:11571:x1869977655274112:12345-192.168.204.36@tcp:55:lhsmtool_posix.0 Request processed in 12225us (16147us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783349841.754141:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 228 00000100:00100000:3.0:1783349841.757032:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349841.757313:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655274368 00000100:00100000:2.0:1783349841.757325:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655274368 00000100:00100000:2.0:1783349841.757433:0:11848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:2.0:1783349841.757444:0:11848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2362:x1869977655274368:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783349841.757494:0:11848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.757517:0:11848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 8 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.757527:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349841.757532:0:11848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783349841.757537:0:11848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.757590:0:11848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 8 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.757606:0:11848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 8 pid: 6580 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349841.757622:0:11848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11848:1869977666783488:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349841.757763:0:11848:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349841.765895:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.765997:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655274496 00000100:00100000:0.0:1783349841.766032:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655274496 00000100:00100000:2.0:1783349841.766039:0:11848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11848:1869977666783488:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349841.766074:0:11848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.766106:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 9 pid: 6580 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.766159:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:0.0:1783349841.766170:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc590ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+9:2361:x1869977655274496:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349841.766193:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349841.766221:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 9 pid: 6580 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.766236:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 9 pid: 6580 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.766265:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0cf4f0c/0x68b4a22a48477176 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd1e expref: 9 pid: 6580 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.766286:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349841.766291:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349841.766299:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.766311:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.766356:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349841.766570:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc590ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655274496:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 400us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.766591:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 85 00010000:00010000:2.0:1783349841.766673:0:11848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766684:0:11848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766716:0:11848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766726:0:11848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766745:0:11848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766754:0:11848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349841.766759:0:11848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766769:0:11848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766782:0:11848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.766828:0:11848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a48477199 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349841.766894:0:11848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655274368:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 9452us (9872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349841.766903:0:11848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:1.0:1783349841.771458:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.771859:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655274752 00000100:00100000:3.0:1783349841.771874:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655274752 00000100:00100000:3.0:1783349841.772515:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 229 00000100:00100000:3.0:1783349841.772536:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:11571:x1869977655274752:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783349841.772664:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.772707:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.772721:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.773057:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.773069:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 20 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.773079:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.773125:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 20 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.773141:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 20 pid: 6605 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.773161:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666783616:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349841.773309:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349841.777250:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.777450:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655274880 00000100:00100000:1.0:1783349841.777464:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655274880 00000100:00100000:0.0:1783349841.777509:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666783616:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349841.777518:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 21 pid: 6605 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.777547:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.777624:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:1.0:1783349841.777635:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c78eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:2361:x1869977655274880:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349841.777655:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349841.777667:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 21 pid: 6605 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.777681:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 21 pid: 6605 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.777725:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030e00/0x68b4a22a4847715a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd09 expref: 21 pid: 6605 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.777745:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:1.0:1783349841.777750:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.777762:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.777769:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.777826:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349841.777901:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c78eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:2361:x1869977655274880:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 268us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.777911:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 86 00010000:00010000:0.0:1783349841.778092:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.778100:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349841.778342:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1783349841.778512:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1783349841.778671:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1783349841.778776:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666783744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783349841.778874:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349841.778914:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d15ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349841.778999:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666783744 00000100:00100000:1.0:1783349841.779008:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666783744 00000100:00100000:1.0:1783349841.779086:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349841.779095:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1869977666783744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783349841.779344:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1869977666783744:12345-0@lo:1000:mdt00_001.0 Request processed in 249us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.779352:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783349841.779407:0:5785:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1783349841.779414:0:5785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1783349841.779435:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320e40aa680, transno 4294967321 00000100:00100000:3.0:1783349841.779487:0:5785:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9320e40a8380 x1869977666782976/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783349857 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349841.779515:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666783744:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783349841.780198:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1783349841.780281:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c750c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666783872:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783349841.780331:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349841.780400:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349841.780919:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666783872 00000100:00100000:1.0:1783349841.780930:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666783872 00000100:00100000:1.0:1783349841.781044:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783349841.781055:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1869977666783872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783349841.781306:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5785:x1869977666783872:12345-0@lo:1000:mdt00_001.0 Request processed in 252us (973us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1783349841.781315:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783349841.781402:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c750c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5785:1869977666783872:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783349841.781447:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781459:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781468:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781475:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349841.781480:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781489:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781510:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320c3886000) 00010000:00010000:3.0:1783349841.781513:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349841.781519:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781525:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781592:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781599:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781605:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781611:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349841.781614:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781620:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781629:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349841.781631:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783349841.781640:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781653:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781664:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349841.781697:0:5785:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.781721:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb4d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666784000:192.168.204.36@tcp:105: 00000100:00100000:3.0:1783349841.781861:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c7c65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349841.785860:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.786019:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb4d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5785:1869977666784000:192.168.204.36@tcp:105: 00010000:00010000:0.0:1783349841.786061:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786085:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484770ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786130:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786147:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786174:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786187:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786194:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786202:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786209:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349841.786213:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786221:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786235:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:0.0:1783349841.786238:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349841.786242:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786249:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a484771ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786259:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786265:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786278:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786284:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c0030c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349841.786287:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786295:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786304:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:0.0:1783349841.786307:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349841.786310:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.786317:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030c00/0x68b4a22a484771a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.786699:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:11571:x1869977655274752:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 14168us (15248us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1783349841.786712:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 229 00000020:00080000:0.0:1783349841.786720:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783349841.787122:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655275008 00000100:00100000:1.0:1783349841.787137:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655275008 00000100:00100000:1.0:1783349841.787206:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:1.0:1783349841.787218:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:11570:x1869977655275008:12345-192.168.204.36@tcp:49:lfs.0 00000100:00100000:1.0:1783349841.787346:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:11570:x1869977655275008:12345-192.168.204.36@tcp:49:lfs.0 Request processed in 131us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.787353:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:3.0:1783349841.789405:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.789591:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655275264 00000100:00100000:1.0:1783349841.789603:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655275264 00000100:00100000:1.0:1783349841.789672:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:1.0:1783349841.789684:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c89e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+23:11571:x1869977655275264:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1783349841.790239:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:3.0:1783349841.790247:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000040:00080000:2.0:1783349841.790248:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349841.790917:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783349841.790927:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783349841.791342:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655275520 00000100:00100000:0.0:1783349841.791356:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655275520 00000004:00080000:1.0:1783349841.791890:0:5788:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783349841.792026:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1783349841.792109:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.792130:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.792145:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.792155:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.792173:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.792180:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.792204:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349841.792233:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349841.792243:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.792259:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349841.792266:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.792275:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.792291:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9320e0103000) 00010000:00010000:2.0:1783349841.792300:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783349841.792306:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349841.792312:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.792342:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 230 00010000:00010000:2.0:1783349841.792344:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349841.792345:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c89e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11571:x1869977655275264:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 2661us (2951us total) trans 4294967515 rc 0/0 00010000:00010000:2.0:1783349841.792348:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349841.792352:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349841.792361:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:0.0:1783349841.792362:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11570:x1869977655275520:12345-192.168.204.36@tcp:58:lfs.0 00000020:00080000:1.0:1783349841.792369:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1783349841.792763:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783349841.793031:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+25:11570:x1869977655275520:12345-192.168.204.36@tcp:58:lfs.0 Request processed in 509us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.793053:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 230 00000100:00100000:3.0:1783349841.822849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349841.823101:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655275648 00000100:00100000:1.0:1783349841.823118:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655275648 00000100:00100000:1.0:1783349841.823194:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 231 00000100:00100000:1.0:1783349841.823206:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+25:11573:x1869977655275648:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349841.823242:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349841.823273:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484771bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd25 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823373:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823391:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823407:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823426:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823457:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823464:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823915:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823932:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.823942:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.824004:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.824023:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 26 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349841.824350:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5784:1869977666784128:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349841.824754:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0bf6480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349841.826673:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349841.826760:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655275904 00000100:00100000:1.0:1783349841.826764:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5784:1869977666784128:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349841.826770:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655275904 00010000:00010000:1.0:1783349841.826866:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349841.826901:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:3.0:1783349841.826915:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:5566:x1869977655275904:12345-192.168.204.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783349841.827360:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:5566:x1869977655275904:12345-192.168.204.36@tcp:35:ldlm_bl.0 Request processed in 447us (696us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1783349841.827370:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 63 00000100:00100000:3.0:1783349841.829563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349841.829690:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655276032 00000100:00100000:0.0:1783349841.829704:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655276032 00010000:00010000:0.0:1783349841.829758:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 28 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349841.829892:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:0.0:1783349841.829904:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:2361:x1869977655276032:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349841.829925:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349841.830020:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 28 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.830039:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 28 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.830071:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030600/0x68b4a22a484770dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bce6 expref: 28 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.830096:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:0.0:1783349841.830102:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.830114:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.830124:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349841.830270:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349841.830352:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:2361:x1869977655276032:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 449us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349841.830360:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 87 00010000:00010000:1.0:1783349841.831547:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831581:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349841.831645:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783349841.831650:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349841.831677:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831693:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831706:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831715:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831722:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831729:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacaa00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349841.831734:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831742:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831758:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349841.831762:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349841.831767:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831784:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacaa00/0x68b4a22a484771c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831916:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831924:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831940:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831946:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349841.831950:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831956:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831965:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9320e0103a00) 00010000:00010000:1.0:1783349841.831967:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349841.831971:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.831977:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a484771ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.832047:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a484771bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd25 expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.832063:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd25 expref: 26 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349841.832079:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349841.832081:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349841.832173:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca200, rc 0) 00000100:00100000:1.0:1783349841.832291:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11573:x1869977655275648:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 9088us (9500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349841.832299:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 231 00000040:00080000:3.0:1783349842.399787:0:12342:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349842.399831:0:12342:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349842.399893:0:12342:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783349842.399903:0:12342:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783349842.601933:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349842.794066:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349842.794077:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349842.794114:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783349842.794120:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349842.794480:0:11518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666784256:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349842.795378:0:11518:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349842.799649:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349842.799759:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655276160 00000100:00100000:3.0:1783349842.799773:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655276160 00000100:00100000:3.0:1783349842.799895:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00080000:2.0:1783349842.799902:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349842.799917:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:11585:x1869977655276160:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783349842.799978:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783349842.800129:0:11518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11518:1869977666784256:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783349842.803527:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11585:x1869977655276160:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 3604us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349842.803565:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 232 00000100:00100000:2.0:1783349842.806908:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349842.807117:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655276416 00000100:00100000:0.0:1783349842.807128:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655276416 00000100:00100000:0.0:1783349842.807195:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:0.0:1783349842.807206:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+26:11585:x1869977655276416:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349842.807233:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349842.807259:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd2c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.807374:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a484771df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.807390:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a484771df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.807470:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a484771df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349842.807484:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783349842.807622:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd2c expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.807643:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a484771df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd2c expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.807667:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:0.0:1783349842.807670:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349842.807674:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7200, rc 0) 00000100:00100000:0.0:1783349842.807742:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:11585:x1869977655276416:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 538us (843us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783349842.807750:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 233 00000100:00100000:1.0:1783349842.813516:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349842.813647:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349842.813750:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655276800 00000100:00100000:3.0:1783349842.813764:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655276800 00000100:00100000:3.0:1783349842.813903:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:3.0:1783349842.813925:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:2362:x1869977655276800:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349842.813948:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349842.813996:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7200/0x68b4a22a484771df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd2c expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349842.814019:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349842.814025:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349842.814113:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:2362:x1869977655276800:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 182us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349842.814122:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:0.0:1783349842.814160:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655276672 00000100:00100000:0.0:1783349842.814165:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655276672 00000100:00100000:0.0:1783349842.814201:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 234 00000100:00100000:0.0:1783349842.814207:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+27:11585:x1869977655276672:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783349842.814378:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814400:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814413:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814636:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814643:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814648:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814666:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349842.814670:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814676:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814683:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:0.0:1783349842.814685:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349842.814688:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349842.814692:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6400/0x68b4a22a484771ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349842.814884:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:11585:x1869977655276672:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 675us (1383us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1783349842.814889:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 234 00000040:00080000:1.0:1783349842.815015:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349842.815021:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349842.815651:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783349842.815662:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783349842.819404:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349842.819642:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277056 00000100:00100000:2.0:1783349842.819656:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277056 00000100:00100000:2.0:1783349842.819736:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 64 00000100:00100000:2.0:1783349842.819746:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+28:11585:x1869977655277056:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349842.820680:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:11585:x1869977655277056:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 930us (1287us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783349842.820692:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 64 00000001:00080000:2.0:1783349843.367969:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1783349843.368015:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1783349843.626359:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349844.028265:0:12395:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349844.028276:0:12395:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349844.028322:0:12395:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783349844.028328:0:12395:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783349844.161214:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349844.161254:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277312 00000100:00100000:3.0:1783349844.161263:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277312 00000100:00100000:3.0:1783349844.161326:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00100000:3.0:1783349844.161337:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+29:11605:x1869977655277312:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349844.161365:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349844.161386:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031200/0x68b4a22a484771f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd33 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349844.161500:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349844.161516:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349844.161538:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349844.161550:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783349844.161673:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0031200/0x68b4a22a484771f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd33 expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349844.161690:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd33 expref: 31 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349844.161699:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:3.0:1783349844.161702:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783349844.161705:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030400, rc 0) 00000100:00100000:3.0:1783349844.161762:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:11605:x1869977655277312:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 427us (560us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1783349844.161770:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 235 00000100:00080000:3.0:1783349844.161807:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349844.167543:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349844.167660:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277440 00000100:00100000:1.0:1783349844.167670:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277440 00000100:00100000:1.0:1783349844.167722:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:1.0:1783349844.167732:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:11605:x1869977655277440:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1783349844.170136:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170168:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170181:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170230:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170238:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170245:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170251:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349844.170255:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170263:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170275:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349844.170278:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349844.170283:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349844.170289:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349844.170395:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+31:11605:x1869977655277440:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 2659us (2856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349844.170408:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 236 00000100:00100000:3.0:1783349844.219335:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349844.219467:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277568 00000100:00100000:2.0:1783349844.219476:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277568 00000100:00100000:2.0:1783349844.219591:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:2.0:1783349844.219602:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2360:x1869977655277568:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:2.0:1783349844.219623:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349844.219650:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006191f343/0x68b4a22a48477210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd3a expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349844.219689:0:6580:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a4bc24f, atime: 0x6a4bc24f, ctime: 0x6a4bc24f, blocks: 0xb 00010000:00010000:2.0:1783349844.219777:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=231s v=(0 0) 00010000:00010000:2.0:1783349844.219781:0:6580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349844.219840:0:6580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006191f343/0x68b4a22a48477210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd3a expref: 8 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349844.219864:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006191f343/0x68b4a22a48477210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd3a expref: 8 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349844.219908:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97e00, rc 0) 00000100:00100000:2.0:1783349844.219982:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2360:x1869977655277568:12345-192.168.204.36@tcp:101:cat.0 Request processed in 382us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349844.219990:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00080000:3.0:1783349844.220058:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349844.223836:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349844.224384:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277696 00000100:00100000:1.0:1783349844.224393:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277696 00002000:00100000:1.0:1783349844.224440:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9320faaf6300 x1869977655277696/t0(0) o3->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:595/0 lens 488/0 e 0 to 0 dl 1783349855 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349844.224466:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320faaf6300 with x1869977655277696 ext(0->4095) 00002000:00010000:1.0:1783349844.224472:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320faaf6300 00000100:00100000:1.0:1783349844.224509:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:1.0:1783349844.224520:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655277696:12345-192.168.204.36@tcp:3:cat.0 00000100:00100000:1.0:1783349844.225277:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+8:2361:x1869977655277696:12345-192.168.204.36@tcp:3:cat.0 Request processed in 752us (1485us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783349844.225286:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00002000:00100000:1.0:1783349844.225294:0:6586:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9320faaf6300 x1869977655277696/t0(0) o3->ed421ea5-67f7-4096-abd5-85a5a23dfd60@192.168.204.36@tcp:595/0 lens 488/4536 e 0 to 0 dl 1783349855 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783349844.225779:0:6586:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320faaf6300 with x1869977655277696 ext(0->4095) 00002000:00010000:1.0:1783349844.225785:0:6586:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320faaf6300 00000100:00100000:2.0:1783349844.330857:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666784384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349844.330958:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349844.331159:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666784384 00000100:00100000:0.0:1783349844.331168:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666784384 00000100:00080000:3.0:1783349844.331234:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349844.331242:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783349844.331252:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666784384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349844.331289:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349844.331348:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666784384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349844.331356:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783349844.331959:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666784384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783349844.576597:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349844.576720:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349844.576762:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349844.577010:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277824 00000100:00100000:2.0:1783349844.577022:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277824 00000100:00100000:1.0:1783349844.577144:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278080 00000100:00100000:1.0:1783349844.577149:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278080 00000100:00100000:1.0:1783349844.577198:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1783349844.577208:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655278080:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349844.577292:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48a60ae5-4060-4be4-9464-772b1677edda+5:2360:x1869977655278080:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 84us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349844.577299:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00080000:1.0:1783349844.577430:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349844.578847:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:2.0:1783349844.578864:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655277824:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349844.578954:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655277824:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 97us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349844.578961:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 272 00000100:00100000:3.0:1783349844.580853:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655277952 00000100:00100000:3.0:1783349844.580868:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655277952 00000100:00100000:3.0:1783349844.581066:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:3.0:1783349844.581079:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655277952:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1783349844.581084:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349844.581183:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2360:x1869977655277952:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 108us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349844.581191:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00010000:00010000:2.0:1783349844.651849:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349845.674016:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349845.866641:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666784896:0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.866651:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666784512:0@lo:400:kworker.0 00000100:00100000:2.0:1783349845.866753:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666784768:0@lo:400:kworker.0 00000100:00100000:0.0:1783349845.868077:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349845.869542:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349845.869619:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666785024:0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.869690:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349845.869750:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785024 00000100:00100000:1.0:1783349845.869760:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785024 00000100:00100000:1.0:1783349845.869848:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783349845.869858:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.869931:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666785024:12345-0@lo:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349845.869939:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1783349845.869973:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349845.870013:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666785024:0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870065:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666784640:0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870094:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349845.870114:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666785152:0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870140:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349845.870172:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666784640 00000100:00100000:1.0:1783349845.870176:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666784640 00000100:00100000:1.0:1783349845.870198:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349845.870205:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666784640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870240:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666784640:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349845.870246:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783349845.870264:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666784896 00000100:00100000:1.0:1783349845.870268:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666784896 00000100:00100000:1.0:1783349845.870293:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785152 00000100:00100000:1.0:1783349845.870296:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785152 00000100:00100000:1.0:1783349845.870322:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783349845.870328:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666784896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870375:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666784896:12345-0@lo:400:kworker.0 Request processed in 47us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349845.870382:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783349845.870395:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349845.870401:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666785152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870431:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666785152:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349845.870438:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1783349845.870460:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349845.870476:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666784640:0@lo:400:kworker.0 00000100:00100000:1.0:1783349845.870485:0:3293:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1783349845.870491:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320fb4d3b80, transno 4294967307 00000004:00080000:1.0:1783349845.870510:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1783349845.870531:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320faaf7100, transno 4294967310 00000100:00100000:1.0:1783349845.870537:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666785152:0@lo:400:kworker.0 00000100:00100000:2.0:1783349845.872204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349845.872328:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666784768 00000100:00100000:1.0:1783349845.872339:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666784768 00000100:00100000:1.0:1783349845.872411:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783349845.872421:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666784768:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783349845.872488:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349845.872495:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666784768:12345-0@lo:400:kworker.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349845.872504:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783349845.872532:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666784768:0@lo:400:kworker.0 00000100:00100000:0.0:1783349845.875064:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666784512 00000100:00100000:0.0:1783349845.875093:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666784512 00000100:00100000:0.0:1783349845.875203:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1783349845.875216:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666784512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349845.875341:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666784896:0@lo:400:kworker.0 00000100:00100000:0.0:1783349845.875472:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666784512:12345-0@lo:400:kworker.0 Request processed in 258us (5937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349845.875481:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1783349845.875769:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666784512:0@lo:400:kworker.0 00000100:00100000:2.0:1783349846.378251:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666785280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349846.378326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349846.378466:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785280 00000100:00100000:3.0:1783349846.378475:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785280 00000100:00100000:3.0:1783349846.378535:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349846.378545:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666785280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349846.378588:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349846.378634:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666785280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349846.378642:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783349846.378725:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666785280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783349846.699166:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783349846.926037:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1783349846.926051:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1783349846.926241:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1783349846.926286:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1783349846.926323:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1783349846.926337:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1783349846.926367:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:1.0:1783349846.926373:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1783349846.926383:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9320c7c65300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783349846.926387:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320c4b16d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9320c7c65900 00000020:00080000:1.0:1783349846.926390:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9320c4b16200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9320fab8a400 00000020:00080000:2.0:1783349846.926422:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1783349846.926592:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1783349847.724195:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349847.926070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349847.926616:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278208 00000100:00100000:2.0:1783349847.926637:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278208 00000100:00080000:1.0:1783349847.926913:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349847.927001:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:2.0:1783349847.927017:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11259:x1869977655278208:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783349847.927576:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11259:x1869977655278208:12345-192.168.204.36@tcp:60:lhsmtool_posix.0 Request processed in 562us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349847.927587:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 237 00000100:00100000:2.0:1783349847.931135:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349847.932191:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278464 00000100:00100000:1.0:1783349847.934556:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278464 00000100:00100000:2.0:1783349847.934909:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:2.0:1783349847.934994:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:11259:x1869977655278464:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349847.935633:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:11259:x1869977655278464:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 641us (4510us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783349847.936489:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 65 00000100:00100000:3.0:1783349848.101275:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349848.101532:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278592 00000100:00100000:1.0:1783349848.101549:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278592 00000100:00100000:1.0:1783349848.101656:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00100000:1.0:1783349848.101670:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:12056:x1869977655278592:12345-192.168.204.36@tcp:101:lsof.0 00010000:00010000:1.0:1783349848.101702:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349848.101736:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48477217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd41 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349848.101885:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847721e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349848.101903:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847721e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349848.101917:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847721e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349848.102396:0:6605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783349848.102409:0:6605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349848.102562:0:6605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847721e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349848.102599:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb400/0x68b4a22a48477217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd41 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349848.102620:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847721e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd41 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349848.102630:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:1.0:1783349848.102634:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349848.102638:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349848.102929:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:12056:x1869977655278592:12345-192.168.204.36@tcp:101:lsof.0 Request processed in 1261us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349848.102937:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 238 00000100:00080000:2.0:1783349848.103071:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783349848.745977:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349849.453314:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666785408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349849.453425:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349849.453621:0:8312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785408 00000100:00100000:0.0:1783349849.453632:0:8312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785408 00000100:00100000:0.0:1783349849.453708:0:8312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349849.453720:0:8312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666785408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349849.453777:0:8312:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349849.453896:0:8312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666785408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349849.453905:0:8312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349849.453950:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1783349849.453956:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320e40a8380, transno 4294967322 00000004:00080000:0.0:1783349849.453968:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00080000:2.0:1783349849.463749:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783349849.464175:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666785408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349849.698338:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349849.698403:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349849.698437:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349849.698477:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278976 00000100:00100000:2.0:1783349849.698478:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278720 00000100:00100000:2.0:1783349849.698492:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278720 00000100:00100000:3.0:1783349849.698493:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278976 00000100:00100000:1.0:1783349849.698551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349849.698565:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00100000:3.0:1783349849.698574:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:2.0:1783349849.698581:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2362:x1869977655278720:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349849.698592:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655278976:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349849.698674:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2362:x1869977655278976:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349849.698682:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:2.0:1783349849.698974:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2362:x1869977655278720:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 399us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349849.698996:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 274 00000100:00080000:2.0:1783349849.699026:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349849.702129:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349849.702903:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655279232 00000100:00100000:0.0:1783349849.702919:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655279232 00000100:00100000:2.0:1783349849.702934:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655278848 00000100:00100000:2.0:1783349849.702942:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655278848 00000100:00100000:2.0:1783349849.703034:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:2.0:1783349849.703048:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:2362:x1869977655278848:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349849.703049:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:0.0:1783349849.703064:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+6:2362:x1869977655279232:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349849.703163:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48a60ae5-4060-4be4-9464-772b1677edda+6:2362:x1869977655279232:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 103us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349849.703173:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:3.0:1783349849.703199:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655279104 00000100:00100000:3.0:1783349849.703206:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655279104 00000100:00100000:3.0:1783349849.703251:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 70 00000100:00100000:3.0:1783349849.703260:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655279104:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:1.0:1783349849.703333:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349849.703338:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349849.703641:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:2362:x1869977655278848:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 595us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349849.703649:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:3.0:1783349849.704190:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2362:x1869977655279104:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 929us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349849.704220:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 70 00010000:00010000:1.0:1783349849.770921:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349850.795066:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783349850.825401:0:12596:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:57:28 (1783349848) 00000100:00100000:3.0:1783349850.986706:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666785536:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.986783:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.986866:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666786048:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.986900:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.986931:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783349850.986939:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666785920:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.986972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.987005:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666785664:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987039:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.987067:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666786176:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987099:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.987127:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349850.987135:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666785792:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987166:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349850.987209:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786048 00000100:00100000:3.0:1783349850.987218:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786048 00000100:00100000:3.0:1783349850.987276:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785664 00000100:00100000:3.0:1783349850.987280:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785664 00000100:00100000:3.0:1783349850.987293:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785792 00000100:00100000:3.0:1783349850.987295:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785792 00000100:00100000:3.0:1783349850.987312:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783349850.987320:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987392:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666786048:12345-0@lo:400:kworker.0 Request processed in 71us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349850.987402:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783349850.987433:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783349850.987442:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666785664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987478:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666785664:12345-0@lo:400:kworker.0 Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349850.987484:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783349850.987497:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783349850.987504:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666785792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987531:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666785792:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349850.987538:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783349850.987559:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785920 00000100:00100000:3.0:1783349850.987562:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785920 00000100:00100000:3.0:1783349850.987594:0:7807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786176 00000100:00100000:3.0:1783349850.987598:0:7807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786176 00000100:00100000:3.0:1783349850.987632:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783349850.987640:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666785920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987677:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666785920:12345-0@lo:400:kworker.0 Request processed in 38us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349850.987684:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783349850.987700:0:7807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783349850.987708:0:7807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666786176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.987740:0:7807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666786176:12345-0@lo:400:kworker.0 Request processed in 34us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349850.988485:0:7807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1783349850.988516:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349850.988521:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349850.988553:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666785920:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.988565:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666786048:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.988600:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666785792:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.988610:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666785664:0@lo:400:kworker.0 00000100:00100000:3.0:1783349850.988619:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666786176:0@lo:400:kworker.0 00000100:00100000:2.0:1783349850.988728:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666785536 00000100:00100000:2.0:1783349850.988734:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666785536 00000100:00100000:2.0:1783349850.988766:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1783349850.988774:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666785536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349850.988874:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666785536:12345-0@lo:400:kworker.0 Request processed in 100us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349850.988881:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000040:00080000:2.0:1783349850.989036:0:11518:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349850.989041:0:11518:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349850.989405:0:11518:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000100:00100000:3.0:1783349850.989412:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666785536:0@lo:400:kworker.0 00000040:00080000:2.0:1783349850.989414:0:11518:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783349851.500048:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349851.500169:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349851.505163:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786304 00000100:00100000:1.0:1783349851.505187:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786304 00000100:00100000:1.0:1783349851.505286:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349851.505301:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666786304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349851.505370:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349851.506651:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1869977666786304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1339us (6469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349851.506667:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783349851.511048:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666786304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783349851.818560:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783349852.049608:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1783349852.049623:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783349852.049704:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783349852.049715:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783349852.842277:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349853.265977:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349853.266102:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655279488 00000100:00100000:0.0:1783349853.266114:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655279488 00000100:00100000:0.0:1783349853.266189:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00100000:0.0:1783349853.266200:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+18:12276:x1869977655279488:12345-192.168.204.36@tcp:35:umount.0 00000100:00100000:0.0:1783349853.266775:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:12276:x1869977655279488:12345-192.168.204.36@tcp:35:umount.0 Request processed in 567us (797us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1783349853.266785:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 66 00000100:00080000:3.0:1783349853.266974:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349853.270608:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349853.273789:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655279744 00000100:00100000:2.0:1783349853.273822:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655279744 00000100:00100000:2.0:1783349853.273978:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:2.0:1783349853.273990:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+19:12276:x1869977655279744:12345-192.168.204.36@tcp:35:umount.0 00000100:00100000:2.0:1783349853.274349:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:12276:x1869977655279744:12345-192.168.204.36@tcp:35:umount.0 Request processed in 361us (3749us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783349853.274357:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 67 00000100:00100000:1.0:1783349853.277402:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349853.278544:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655280000 00000100:00100000:0.0:1783349853.278562:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655280000 00000100:00100000:0.0:1783349853.278631:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:0.0:1783349853.278643:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c899e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+20:12276:x1869977655280000:12345-192.168.204.36@tcp:35:umount.0 00000100:00100000:0.0:1783349853.279276:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c899e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:12276:x1869977655280000:12345-192.168.204.36@tcp:35:umount.0 Request processed in 633us (1888us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1783349853.279285:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 68 00000100:00100000:3.0:1783349853.283200:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349853.283329:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655280256 00000100:00100000:2.0:1783349853.283340:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655280256 00000100:00100000:0.0:1783349853.283516:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:0.0:1783349853.283533:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+21:12276:x1869977655280256:12345-192.168.204.36@tcp:35:umount.0 00000100:00100000:0.0:1783349853.284326:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:12276:x1869977655280256:12345-192.168.204.36@tcp:35:umount.0 Request processed in 796us (1133us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783349853.284336:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 69 00000100:00100000:2.0:1783349853.290502:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349853.290553:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349853.290720:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655280384 00000100:00100000:1.0:1783349853.290735:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655280384 00000100:00100000:1.0:1783349853.290919:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655280512 00000100:00100000:1.0:1783349853.290923:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655280512 00000100:00100000:0.0:1783349853.291889:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:0.0:1783349853.291915:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+14:2360:x1869977655280384:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349853.291942:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349853.291970:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050000/0x68b4a22a48476296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8cc expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349853.291996:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349853.292135:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+13:2360:x1869977655280384:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 234us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.292142:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:0.0:1783349853.292163:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1783349853.292167:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:2360:x1869977655280512:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349853.292174:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349853.292184:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9003200/0x68b4a22a484761fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b894 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349853.292200:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349853.292214:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:2360:x1869977655280512:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 47us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.292219:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:2.0:1783349853.292807:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349853.292844:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349853.292915:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655280768 00000100:00100000:1.0:1783349853.292926:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655280768 00000100:00100000:1.0:1783349853.292976:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:1.0:1783349853.292985:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:2359:x1869977655280768:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349853.292999:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349853.293013:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175b800/0x68b4a22a48476480 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b997 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.293027:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349853.293051:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655280640 00000100:00100000:0.0:1783349853.293057:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655280640 00000100:00100000:1.0:1783349853.293060:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2359:x1869977655280768:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349853.293066:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:0.0:1783349853.293125:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:0.0:1783349853.293133:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+5:2358:x1869977655280640:12345-192.168.204.36@tcp:9:umount.0 00000020:00000080:0.0:1783349853.293168:0:6580:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a4847656e 00000100:00080000:0.0:1783349853.293180:0:6580:0:(import.c:65:import_set_state_nolock()) ffff9320c8e74800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349853.293242:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1783349853.293398:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783349853.293568:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349853.293599:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed421ea5-67f7-4096-abd5-85a5a23dfd60+2:2358:x1869977655280640:12345-192.168.204.36@tcp:9:umount.0 Request processed in 465us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349853.293607:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:1.0:1783349853.297703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349853.297994:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655281152 00000100:00100000:3.0:1783349853.298011:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655281152 00000100:00080000:0.0:1783349853.298068:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349853.298103:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:3.0:1783349853.298116:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+7:2358:x1869977655281152:12345-192.168.204.36@tcp:9:umount.0 00000020:00000080:3.0:1783349853.298161:0:6579:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484767cf 00000020:00010000:3.0:1783349853.298170:0:6579:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9320fb53e800: total 0 00000100:00080000:3.0:1783349853.298176:0:6579:0:(import.c:65:import_set_state_nolock()) ffff9320fb539800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783349853.298225:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1783349853.298245:0:7481:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9320fb53e800: total 0 00010000:00010000:0.0:1783349853.298300:0:7481:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9320fb53e800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783349853.298376:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ac3649/0x68b4a22a48476b72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb6c expref: 6 pid: 11848 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349853.298412:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006191f343/0x68b4a22a48477210 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd3a expref: 5 pid: 6580 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349853.298427:0:7481:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9320fb53e800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783349853.298440:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349853.298442:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349853.298444:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349853.298834:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+2:2358:x1869977655281152:12345-192.168.204.36@tcp:9:umount.0 Request processed in 718us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349853.298845:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:2.0:1783349853.307150:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349853.307348:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655282176 00000100:00100000:3.0:1783349853.307750:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655282176 00000100:00100000:3.0:1783349853.308167:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 239 00000100:00100000:3.0:1783349853.308180:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+22:2358:x1869977655282176:12345-192.168.204.36@tcp:39:umount.0 00000020:00000080:3.0:1783349853.308229:0:5785:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a4847620a 00000020:00010000:3.0:1783349853.308254:0:5785:0:(genops.c:1942:obd_stale_export_put()) Put export ffff931fc7b8f000: total 0 00000100:00080000:3.0:1783349853.308259:0:5785:0:(import.c:65:import_set_state_nolock()) ffff931fc7b88000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783349853.308296:0:5785:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1783349853.308605:0:5772:0:(genops.c:1928:obd_stale_export_get()) Get export ffff931fc7b8f000: total 0 00010000:00010000:1.0:1783349853.308685:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff931fc7b8f000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783349853.308738:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349853.308743:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349853.308780:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a48476a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb1f expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.308828:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349853.308832:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783349853.308837:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320d175b600/0x68b4a22a48476544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9c1 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.308854:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349853.308857:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783349853.308865:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97000/0x68b4a22a484770f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bced expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.308883:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349853.308886:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783349853.308890:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96400/0x68b4a22a48476bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb8f expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.308906:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103300) 00010000:00010000:1.0:1783349853.308909:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349853.308914:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbe00/0x68b4a22a484764f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9ac expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349853.308924:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed421ea5-67f7-4096-abd5-85a5a23dfd60+17:2358:x1869977655282176:12345-192.168.204.36@tcp:39:umount.0 Request processed in 739us (1783us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783349853.308935:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 239 00010000:00010000:1.0:1783349853.308938:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:1.0:1783349853.308943:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349853.308949:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97800/0x68b4a22a48476bd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb88 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.308963:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349853.308971:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783349853.308977:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c0030400/0x68b4a22a484771fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd33 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.308997:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349853.309000:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349853.309003:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a48476b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb57 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.309013:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9320cf8b3700) 00010000:00010000:1.0:1783349853.309015:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349853.309017:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca200/0x68b4a22a484771d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd25 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.309030:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9320c3886d00) 00010000:00010000:1.0:1783349853.309031:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349853.309033:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97a00/0x68b4a22a48476ecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bc61 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.309044:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349853.309046:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783349853.309048:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a48476831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6ba93 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.309062:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9320cf8b3300) 00010000:00010000:1.0:1783349853.309064:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349853.309067:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484764d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b9a5 expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.309096:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9320c3886f00) 00010000:00010000:1.0:1783349853.309099:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783349853.309103:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a48476b5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bb65 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349853.309117:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff931fc7b8f000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783349853.309131:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349853.309134:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349853.309135:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783349853.580166:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:0.0:1783349853.580178:0:7491:0:(genops.c:906:class_export_put()) final put ffff9320d0b57800/ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:2.0:1783349853.580263:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320d0b57800/ed421ea5-67f7-4096-abd5-85a5a23dfd60 for lustre-OST0001 00000020:00000080:2.0:1783349853.580334:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c8e74800 for lustre-OST0001 00010000:00010000:1.0:1783349853.866117:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349854.413908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349854.413962:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349854.414205:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349854.414420:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655282304 00000100:00100000:3.0:1783349854.414436:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655282304 00000100:00100000:3.0:1783349854.414502:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655282432 00000100:00100000:3.0:1783349854.414505:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655282432 00000100:00100000:3.0:1783349854.414519:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655282560 00000100:00100000:3.0:1783349854.414523:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655282560 00000100:00100000:3.0:1783349854.414543:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:3.0:1783349854.414554:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+12:2359:x1869977655282304:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349854.414681:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349854.414849:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faacb600/0x68b4a22a484762dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8e1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349854.414871:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349854.414953:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+11:2359:x1869977655282304:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 398us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349854.414962:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:3.0:1783349854.414989:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:3.0:1783349854.414996:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c78ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+10:2359:x1869977655282432:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349854.415023:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349854.415034:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac96c00/0x68b4a22a48476479 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b990 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349854.415044:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349854.415062:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c78ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+9:2359:x1869977655282432:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 67us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349854.415068:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:3.0:1783349854.415120:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:3.0:1783349854.415127:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+8:2359:x1869977655282560:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349854.415135:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349854.415145:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175be00/0x68b4a22a484762e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b90b expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349854.415154:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349854.415171:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eaf26d6-4d34-43dd-a71e-1610389f65c9+7:2359:x1869977655282560:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 45us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349854.415177:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:2.0:1783349854.417123:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349854.417200:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655282816 00000100:00100000:3.0:1783349854.417221:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655282816 00000100:00100000:3.0:1783349854.417288:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 240 00000100:00100000:3.0:1783349854.417298:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+6:2358:x1869977655282816:12345-192.168.204.36@tcp:39:umount.0 00000020:00000080:3.0:1783349854.417345:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484762f1 00000020:00010000:3.0:1783349854.417354:0:6605:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9320c86b2000: total 0 00000100:00080000:3.0:1783349854.417358:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9320c86b2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783349854.417409:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1783349854.417459:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349854.417711:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48a60ae5-4060-4be4-9464-772b1677edda+5:2358:x1869977655282816:12345-192.168.204.36@tcp:39:umount.0 Request processed in 408us (592us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1783349854.417734:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 240 00000020:00010000:1.0:1783349854.417961:0:7481:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9320c86b2000: total 0 00010000:00010000:1.0:1783349854.417967:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349854.418020:0:7481:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9320c86b2000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783349854.418060:0:7481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c3886700) 00010000:00010000:1.0:1783349854.418064:0:7481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349854.418073:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca400/0x68b4a22a4847721e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd41 expref: 4 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349854.418098:0:7481:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9320c86b2000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783349854.418107:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349854.418109:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349854.418111:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349854.431539:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349854.431667:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283072 00000100:00100000:2.0:1783349854.431681:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283072 00000100:00100000:2.0:1783349854.431777:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 276 00000100:00100000:2.0:1783349854.431788:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+7:2358:x1869977655283072:12345-192.168.204.36@tcp:251:umount.0 00000020:00000080:2.0:1783349854.431893:0:5777:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484761e7 00000020:00010000:2.0:1783349854.431903:0:5777:0:(genops.c:1942:obd_stale_export_put()) Put export ffff931fc7b89000: total 0 00000100:00080000:2.0:1783349854.431910:0:5777:0:(import.c:65:import_set_state_nolock()) ffff931fc7b8f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783349854.431995:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8eaf26d6-4d34-43dd-a71e-1610389f65c9+3:2358:x1869977655283072:12345-192.168.204.36@tcp:251:umount.0 Request processed in 208us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349854.432023:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 276 00000020:00010000:1.0:1783349854.432288:0:5772:0:(genops.c:1928:obd_stale_export_get()) Get export ffff931fc7b89000: total 0 00010000:00010000:1.0:1783349854.432352:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff931fc7b89000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783349854.432394:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102051800/0x68b4a22a4847629d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6b8d3 expref: 2 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349854.432412:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff931fc7b89000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783349854.432424:0:5772:0:(genops.c:906:class_export_put()) final put ffff931fc7b89000/8eaf26d6-4d34-43dd-a71e-1610389f65c9 00010000:00010000:1.0:1783349854.432445:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349854.432447:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349854.432449:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783349854.432728:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc7b89000/8eaf26d6-4d34-43dd-a71e-1610389f65c9 for MGS 00000020:00000080:2.0:1783349854.432783:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff931fc7b8f800 for MGS 00000100:00100000:2.0:1783349854.575822:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666786432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349854.575916:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349854.576080:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786432 00000100:00100000:3.0:1783349854.576091:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786432 00000100:00100000:3.0:1783349854.576170:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783349854.576180:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666786432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349854.576225:0:6582:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349854.579917:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666786432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3722us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349854.579937:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1783349854.580076:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349854.580664:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666786432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783349854.891086:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783349855.741587:0:12793:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783349855.755921:0:12793:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783349855.755976:0:12793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.755992:0:12793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.756001:0:12793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.756009:0:12793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.756031:0:12793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783349855.756037:0:12793:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783349855.756063:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349855.756067:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783349855.756074:0:12793:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783349855.756101:0:12793:0:(import.c:65:import_set_state_nolock()) ffff9320fa58a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783349855.756750:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666786560:0@lo:39:umount.0 00000100:00100000:2.0:1783349855.756844:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783349855.756974:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349855.756981:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.757006:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051200 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349855.757010:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.757019:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349855.757026:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349855.757031:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349855.757034:0:7481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783349855.757036:0:7481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783349855.757064:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.757070:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349855.757094:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.757100:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051200/0x68b4a22a4847626c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476273 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.757110:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349855.757112:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349855.757113:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349855.757153:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666786688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349855.757272:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786560 00000100:00100000:1.0:1783349855.757286:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786560 00000100:00100000:1.0:1783349855.757339:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783349855.757348:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1869977666786560:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783349855.757373:0:5786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475ff6 00000100:00080000:1.0:1783349855.757381:0:5786:0:(import.c:65:import_set_state_nolock()) ffff9320f7d8e000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783349855.757469:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349855.757501:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349855.757544:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786688 00000100:00100000:0.0:1783349855.757549:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786688 00000100:00100000:0.0:1783349855.757582:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783349855.757595:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3292:x1869977666786688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349855.757606:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349855.757620:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9003e00/0x68b4a22a48476273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a4847626c expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.757631:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349855.757700:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3290:x1869977666786560:12345-0@lo:39:umount.0 Request processed in 352us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349855.757709:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1783349855.757718:0:5786:0:(genops.c:906:class_export_put()) final put ffff9320f7d8f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783349855.757750:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f7d8f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783349855.757809:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320f7d8e000 for lustre-MDT0000 00000100:00080000:3.0:1783349855.758170:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320fa58a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783349855.758233:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666786560:0@lo:39:umount.0 00000100:00080000:1.0:1783349855.758282:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349855.758286:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783349855.758290:0:12793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783349855.760459:0:12793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760477:0:12793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760484:0:12793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760557:0:12793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760680:0:12793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349855.760769:0:12793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760819:0:12793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760825:0:12793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.760832:0:12793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.760902:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349855.760909:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.760916:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003600 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349855.760919:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.760928:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349855.760935:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349855.760941:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783349855.760951:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783349855.760981:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.760987:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349855.761019:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761026:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9003600/0x68b4a22a4847627a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476281 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761041:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349855.761044:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761049:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051400 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349855.761052:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761059:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349855.761064:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349855.761069:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783349855.761071:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1783349855.761082:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761087:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349855.761100:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761108:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349855.761110:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349855.761112:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349855.761138:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666786816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349855.761201:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349855.761248:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783349855.761254:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666786944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349855.761275:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349855.761304:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783349855.761311:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783349855.761325:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783349855.761332:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786816 00000100:00100000:3.0:1783349855.761338:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786816 00000100:00100000:3.0:1783349855.761368:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783349855.761373:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666786944 00000100:00100000:3.0:1783349855.761375:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666786944 00000100:00100000:3.0:1783349855.761640:0:12794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783349855.761651:0:12794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d1b48f-2d78-45ee-b062-943ed61d9bed+20:3293:x1869977666786816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349855.761666:0:12794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349855.761680:0:12794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175a800/0x68b4a22a48476281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a4847627a expref: 20 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761780:0:12794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349855.761852:0:12794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d1b48f-2d78-45ee-b062-943ed61d9bed+19:3293:x1869977666786816:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349855.761861:0:12794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349855.761877:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666786816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349855.761888:0:12794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783349855.761902:0:12794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d1b48f-2d78-45ee-b062-943ed61d9bed+18:3293:x1869977666786944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349855.761911:0:12794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349855.761920:0:12794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d7534e00/0x68b4a22a484761a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a484761a1 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349855.761932:0:12794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349855.761973:0:12794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3293:x1869977666786944:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349855.761979:0:12794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349855.762060:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47d1b48f-2d78-45ee-b062-943ed61d9bed:3293:1869977666786944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783349855.762380:0:12793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783349855.762388:0:12793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051400/0x68b4a22a484761a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a484761a8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349855.762401:0:12793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783349855.762409:0:12793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762417:0:12793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762424:0:12793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762430:0:12793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762443:0:12793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349855.762448:0:12793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762462:0:12793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762468:0:12793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762474:0:12793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349855.762581:0:12793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783349855.762586:0:12793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783349855.762591:0:12793:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1783349855.762595:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3292:x1869977666786688:12345-0@lo:103:ldlm_bl.0 Request processed in 4997us (5090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349855.762604:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:01000004:1.0:1783349855.762618:0:12793:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783349855.762623:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783349855.762628:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349855.762633:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1783349855.762644:0:12793:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9320c86b3000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349855.762650:0:12793:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9320ff379800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349855.762656:0:12793:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9320c86b2000 48a60ae5-4060-4be4-9464-772b1677edda 192.168.204.36@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349855.762661:0:12793:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff931fc7b8f000 ed421ea5-67f7-4096-abd5-85a5a23dfd60 192.168.204.36@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:1.0:1783349855.762666:0:12793:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9320d22d8000) has exports, disconnecting them 00000020:00080000:1.0:1783349855.762670:0:12793:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9320c86b3000), last request at 1783349850 00000020:00000080:1.0:1783349855.762677:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476169 00000100:00080000:1.0:1783349855.762819:0:12793:0:(import.c:65:import_set_state_nolock()) ffff9320c86b3800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783349855.762873:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47d1b48f-2d78-45ee-b062-943ed61d9bed:3292:1869977666786688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349855.762923:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349855.762929:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.762937:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175b000 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349855.762940:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.762947:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349855.762954:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349855.762971:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783349855.762974:0:7481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783349855.762975:0:7481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783349855.762995:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763001:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349855.763017:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763024:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d175b000/0x68b4a22a484764a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a484764aa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763035:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349855.763038:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763043:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051000 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349855.763046:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763052:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349855.763058:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349855.763063:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783349855.763065:0:7481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783349855.763066:0:7481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783349855.763099:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763105:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349855.763113:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349855.763114:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763123:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051000/0x68b4a22a48475f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48475f5c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349855.763137:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349855.763139:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349855.763142:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349855.763155:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666787072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349855.763190:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349855.763227:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349855.763233:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666787200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349855.763255:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349855.763283:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787072 00000100:00100000:0.0:1783349855.763285:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787200 00000100:00100000:2.0:1783349855.763290:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787072 00000100:00100000:0.0:1783349855.763291:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787200 00000100:00100000:0.0:1783349855.763355:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349855.763364:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+17:3291:x1869977666787072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349855.763374:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1783349855.763380:0:12793:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9320c86b3000): rc 0 00000020:00000080:1.0:1783349855.763385:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c86b3000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1783349855.763386:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175ae00/0x68b4a22a484764aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a484764a3 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349855.763399:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1783349855.763408:0:12793:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9320ff379800), last request at 1783349850 00000020:00000080:1.0:1783349855.763414:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a4847609e 00000100:00080000:1.0:1783349855.763421:0:12793:0:(import.c:65:import_set_state_nolock()) ffff9320ff37f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783349855.763433:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+16:3291:x1869977666787072:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000020:00000080:1.0:1783349855.763440:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c86b3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1783349855.763440:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349855.763458:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783349855.763465:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+15:3291:x1869977666787200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349855.763472:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349855.763481:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673d400/0x68b4a22a48475f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48475f55 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783349855.763483:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c86b3800 for lustre-MDT0000 00010000:00010000:0.0:1783349855.763503:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349855.763523:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3291:x1869977666787200:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349855.763528:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1783349855.763542:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783349855.763559:0:12793:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9320ff379800): rc 0 00000020:00000080:0.0:1783349855.763562:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320ff379800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1783349855.763569:0:12793:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffacb5c2cf7ae0 00000100:00080000:0.0:1783349855.763587:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783349855.763589:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1783349855.763600:0:12793:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1783349855.763641:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320ff379800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1783349855.763660:0:12793:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:1.0:1783349855.763672:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320ff37f000 for lustre-MDT0000 00010000:00010000:3.0:1783349855.763789:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349855.763829:0:12793:0:(import.c:65:import_set_state_nolock()) ffff9320dab71000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783349855.763845:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783349855.763848:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1783349855.763858:0:12793:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783349855.763933:0:12793:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783349855.763946:0:12793:0:(import.c:65:import_set_state_nolock()) ffff931fc7d58000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783349855.763994:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9320d22d8000) has no exports 00000100:00100000:1.0:1783349855.764897:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666787328:0@lo:9:umount.0 00000100:00100000:1.0:1783349855.764950:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349855.764979:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666787456:0@lo:9:umount.0 00000100:00100000:1.0:1783349855.765003:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349855.765062:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787328 00000100:00100000:1.0:1783349855.765068:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787328 00000100:00100000:1.0:1783349855.765109:0:11848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787456 00000100:00100000:1.0:1783349855.765113:0:11848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787456 00000100:00100000:1.0:1783349855.765155:0:11848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783349855.765162:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783349855.765164:0:11848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3290:x1869977666787328:12345-0@lo:9:umount.0 00000100:00100000:0.0:1783349855.765177:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1869977666787456:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783349855.765191:0:11848:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484760eb 00000020:00000080:0.0:1783349855.765195:0:6580:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484761d2 00000100:00080000:1.0:1783349855.765202:0:11848:0:(import.c:65:import_set_state_nolock()) ffff9320fb539000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783349855.765204:0:6580:0:(import.c:65:import_set_state_nolock()) ffff9320c86b1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349855.765246:0:6580:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783349855.765283:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666787200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349855.765296:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666787072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349855.765317:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783349855.765364:0:11848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1783349855.765827:0:11848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3290:x1869977666787328:12345-0@lo:9:umount.0 Request processed in 664us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349855.765835:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3290:x1869977666787456:12345-0@lo:9:umount.0 Request processed in 660us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349855.765840:0:11848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783349855.765849:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783349855.765865:0:5780:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783349855.765928:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349855.766142:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349855.766279:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320dab71000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783349855.766299:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783349855.766301:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349855.766305:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666787328:0@lo:9:umount.0 00000100:00080000:2.0:1783349855.766317:0:3290:0:(import.c:65:import_set_state_nolock()) ffff931fc7d58000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783349855.766335:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783349855.766336:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349855.766340:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666787456:0@lo:9:umount.0 00000020:00080000:0.0:1783349855.775358:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9320d22d8000) has no exports 00000020:00000080:0.0:1783349855.831631:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475fb0 00000020:00000080:0.0:1783349855.831648:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320f76a2800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783349855.831674:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783349855.831735:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f76a2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783349855.831770:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349855.836155:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349855.836165:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9320c726b380) has no exports 00000020:00000080:1.0:1783349855.836653:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475fa9 00000020:00000080:1.0:1783349855.836676:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320fd659800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783349855.836742:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349855.836753:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783349855.836756:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320f7d83800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783349855.836759:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f7d83800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783349855.836766:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783349855.836831:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fd659800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1783349855.914036:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349856.107387:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666787712:0@lo:400:kworker.0 00000100:00100000:0.0:1783349856.107459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349856.107517:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783349856.107524:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666787584:0@lo:400:kworker.0 00000100:00100000:0.0:1783349856.107550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349856.107663:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787712 00000100:00100000:2.0:1783349856.107673:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787712 00000100:00100000:2.0:1783349856.107726:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783349856.107735:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3294:x1869977666787712:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783349856.107743:0:6605:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783349856.107782:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3294:x1869977666787712:12345-0@lo:400:kworker.0 Request processed in 47us (323us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783349856.107788:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783349856.107847:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666787840:0@lo:400:kworker.0 00000100:00100000:2.0:1783349856.107874:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349856.107905:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787840 00000100:00100000:2.0:1783349856.107909:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787840 00000100:00100000:2.0:1783349856.107946:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783349856.107951:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1869977666787840:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783349856.107957:0:5785:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783349856.107999:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1869977666787840:12345-0@lo:400:kworker.0 Request processed in 45us (123us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783349856.108008:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1783349856.108047:0:3291:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783349856.108052:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9320c86b0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783349856.108057:0:3291:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1783349856.108228:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787584 00000100:00100000:3.0:1783349856.108233:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787584 00000100:00100000:3.0:1783349856.108273:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1783349856.108281:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3294:x1869977666787584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349856.108321:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47d1b48f-2d78-45ee-b062-943ed61d9bed+14:3294:x1869977666787584:12345-0@lo:400:kworker.0 Request processed in 41us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349856.108327:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1783349856.110364:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666787584:0@lo:400:kworker.0 00000100:00080000:0.0:1783349856.110388:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783349856.110393:0:3294:0:(import.c:65:import_set_state_nolock()) ffff931fc4706800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783349856.110397:0:3294:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783349856.110402:0:3294:0:(import.c:65:import_set_state_nolock()) ffff931fc4706800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349856.110407:0:3294:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 106 00000100:00080000:0.0:1783349856.110414:0:3294:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff931fc4706800 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:0.0:1783349856.110449:0:3294:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320e40ab480 x1869977666787968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349856.110481:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666787712:0@lo:400:kworker.0 00000100:00100000:1.0:1783349856.111365:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1869977666787968:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783349856.111426:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349856.111470:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666787968 00000100:00100000:3.0:1783349856.111478:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666787968 00000100:00100000:3.0:1783349856.111517:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783349856.111524:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3290:x1869977666787968:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1783349856.111542:0:6605:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1783349856.126705:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9320c86b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349856.126726:0:3291:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 116 00000100:00080000:2.0:1783349856.126760:0:3291:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9320c86b0000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349856.126834:0:3291:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5905880 x1869977666788096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349856.126861:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666787840:0@lo:400:kworker.0 00000100:00100000:1.0:1783349856.127597:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666788096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783349856.127667:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349856.127878:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666788096 00000100:00100000:0.0:1783349856.127887:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666788096 00000100:00100000:0.0:1783349856.127929:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783349856.127937:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1869977666788096:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783349856.127963:0:5785:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783349856.128008:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1869977666788096:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (341us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783349856.128016:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1783349856.128110:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c86b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783349856.128116:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783349856.128120:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666788096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783349856.150192:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3290:x1869977666787968:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 38185us (38284us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783349856.150208:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1783349856.152915:0:3290:0:(import.c:65:import_set_state_nolock()) ffff931fc4706800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783349856.152925:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783349856.152929:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1869977666787968:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1783349856.939215:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783349857.164367:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1783349857.164390:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 48a60ae5-4060-4be4-9464-772b1677edda 00000001:00080000:2.0:1783349857.164396:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1783349857.164399:0:5806:0:(genops.c:906:class_export_put()) final put ffff9320c86b2000/48a60ae5-4060-4be4-9464-772b1677edda 00000001:00100000:2.0:1783349857.164411:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000001:00080000:2.0:1783349857.164415:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1783349857.164417:0:5806:0:(genops.c:906:class_export_put()) final put ffff931fc7b8f000/ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:2.0:1783349857.164425:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c86b2000/48a60ae5-4060-4be4-9464-772b1677edda for lustre-MDT0000 00000020:00000080:2.0:1783349857.164464:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc7b8f000/ed421ea5-67f7-4096-abd5-85a5a23dfd60 for lustre-MDT0000 00000020:00000080:2.0:1783349857.164486:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c86b2800 for lustre-MDT0000 00000020:00000080:2.0:1783349857.164489:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff931fc7b88000 for lustre-MDT0000 00000001:00100000:0.0:1783349857.166489:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783349857.166497:0:6607:0:(genops.c:906:class_export_put()) final put ffff9320fb53a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783349857.166611:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fb53a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:0.0:1783349857.166947:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:0.0:1783349857.166951:0:6607:0:(genops.c:906:class_export_put()) final put ffff9320fb53e800/ed421ea5-67f7-4096-abd5-85a5a23dfd60 00000020:00000080:2.0:1783349857.168025:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320fb539000 for lustre-OST0000 00000020:00000080:2.0:1783349857.168036:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fb53e800/ed421ea5-67f7-4096-abd5-85a5a23dfd60 for lustre-OST0000 00000020:00000080:2.0:1783349857.168075:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320fb539800 for lustre-OST0000 00000020:01000000:1.0:1783349857.897930:0:12793:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320fb302a80 - data ffff9320ec840d80/ffff931fc6c27c00 00000020:01000000:1.0:1783349857.898066:0:12793:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320ec4a9300 - data ffff9320ec842bd0/ffff9320fb9fe400 00000001:00000004:1.0:1783349857.907179:0:12793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00010000:00010000:1.0:1783349857.962660:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349857.968898:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783349857.968917:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783349857.968937:0:12793:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349857.968939:0:12793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783349857.969892:0:7168:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783349857.969898:0:7168:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1783349857.969917:0:7168:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783349857.971057:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783349857.971063:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783349857.971078:0:12793:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783349857.971081:0:12793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783349857.971833:0:7804:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783349857.971840:0:7804:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1783349857.971851:0:7804:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783349858.065484:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f78 00000020:00000080:1.0:1783349858.065496:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c68f3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783349858.069513:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c68f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349858.070337:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f8d 00000020:00000080:1.0:1783349858.070348:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320f7d8d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783349858.070377:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783349858.070383:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349858.070392:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783349858.070395:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9320d22d99c0) has no exports 00000004:01000000:1.0:1783349858.070561:0:12793:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783349858.070570:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484761cb 00000020:00000080:1.0:1783349858.070574:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c970d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783349858.070578:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783349858.070582:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349858.070588:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783349858.070590:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9320f7d90000) has no exports 00000020:00000080:2.0:1783349858.070736:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f7d8d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783349858.070745:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c970d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783349858.070774:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484761c4 00000020:00000080:1.0:1783349858.070781:0:12793:0:(genops.c:906:class_export_put()) final put ffff931fc7d5d800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783349858.071370:0:12793:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783349858.071375:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783349858.071380:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1783349858.071385:0:12793:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349858.071388:0:12793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783349858.071486:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc7d5d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349858.071557:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349858.071565:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783349858.071570:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484760e4 00000020:00000080:1.0:1783349858.071575:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c4e51800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783349858.071600:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff931fc7d58000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783349858.071605:0:37:0:(genops.c:906:class_export_put()) final put ffff9320d0b51800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783349858.071607:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320d0b51800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783349858.071611:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783349858.072032:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783349858.072037:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349858.072042:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783349858.072045:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9320c75ecd40) has no exports 00000020:00000080:1.0:1783349858.072049:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a484760dd 00000020:00000080:1.0:1783349858.072053:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320dab77000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783349858.072074:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c4e51800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1783349858.072491:0:12793:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783349858.072494:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783349858.072497:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1783349858.072500:0:12793:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783349858.072510:0:12793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783349858.072538:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320dab77000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783349858.072628:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349858.072634:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783349858.072657:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349858.072660:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783349858.072663:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320e023f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783349858.072665:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320e023f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783349858.072670:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783349858.072843:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f94 00000020:00000080:1.0:1783349858.072852:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320f7d8c800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783349858.073244:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320dab71000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783349858.073250:0:37:0:(genops.c:906:class_export_put()) final put ffff931fc4707000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783349858.073253:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc4707000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783349858.073257:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783349858.073375:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783349858.073380:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349858.073385:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783349858.073388:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9320f7d94d40) has no exports 00000020:00000080:1.0:1783349858.073408:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349858.073412:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783349858.073416:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f9b 00000020:00000080:1.0:1783349858.073420:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320f7d8a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783349858.073445:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f7d8c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783349858.073449:0:37:0:(genops.c:906:class_export_put()) final put ffff9320f7d8b000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783349858.073451:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f7d8b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783349858.073454:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1783349858.073757:0:12793:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320c6fcb000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783349858.073761:0:12793:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320c6fcb000 3 00000020:01000004:1.0:1783349858.073764:0:12793:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9320c6fcb000 from lustre-MDT0000 00000020:00000080:1.0:1783349858.073783:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349858.073788:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783349858.073805:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c68f7800/lustre-MDT0000_UUID 00000020:00000080:1.0:1783349858.073808:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c68f7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783349858.073817:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783349858.073845:0:12793:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1783349858.073849:0:12793:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783349858.073852:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783349858.073855:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349858.073857:0:12793:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783349858.073863:0:12793:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9320c90ac800 47d1b48f-2d78-45ee-b062-943ed61d9bed 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349858.073869:0:12793:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9320d22dcd40) has exports, disconnecting them 00000020:00080000:1.0:1783349858.073881:0:12793:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9320c90ac800), last request at 1783349709 00000020:00000080:1.0:1783349858.073895:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f39 00000020:00010000:1.0:1783349858.073908:0:12793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9320c90ac800: total 1 00000100:00080000:1.0:1783349858.073914:0:12793:0:(import.c:65:import_set_state_nolock()) ffff9320c90aa800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783349858.073932:0:12793:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9320c90ac800): rc 0 00000020:00080000:1.0:1783349858.073936:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9320d22dcd40) has no exports 00000020:00010000:0.0:1783349858.073949:0:7481:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9320c90ac800: total 1 00010000:00010000:0.0:1783349858.073983:0:7481:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9320c90ac800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783349858.074013:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175a200/0x68b4a22a48476257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476250 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074031:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9003000/0x68b4a22a48476265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a4847625e expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074042:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9002e00/0x68b4a22a4847648e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476487 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074052:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175b200/0x68b4a22a4847649c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476495 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074066:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d673c800/0x68b4a22a48476051 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a4847604a expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074079:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff932102050c00/0x68b4a22a4847628f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476288 expref: 4 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074099:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faacb200/0x68b4a22a48476249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476242 expref: 3 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074109:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320d175a400/0x68b4a22a4847623b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x68b4a22a48476234 expref: 2 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349858.074118:0:7481:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9320c90ac800, canceled 8 locks, left on hash table 0. 00000100:00100000:1.0:1783349858.074127:0:5779:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9320c7819400:5779] 2 exiting: rc = 0 00000020:00000080:0.0:1783349858.074130:0:7481:0:(genops.c:906:class_export_put()) final put ffff9320c90ac800/47d1b48f-2d78-45ee-b062-943ed61d9bed 00000100:00100000:3.0:1783349858.074224:0:5778:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9321005f3600:5778] 1 exiting: rc = 0 00000100:00100000:3.0:1783349858.074285:0:5777:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9320d22e7200:5777] 0 exiting: rc = 1 00000100:00100000:1.0:1783349858.074325:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074333:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074338:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074344:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074349:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074354:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074359:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074365:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074371:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074376:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074382:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074387:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074393:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074398:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074403:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074409:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074414:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074419:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074424:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074429:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074434:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074438:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074443:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074448:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074452:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074457:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074462:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074472:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074476:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074481:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074486:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074496:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074507:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074513:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074522:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074527:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074532:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074541:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074546:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074551:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074559:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074565:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074573:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074578:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074586:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074592:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074608:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074613:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074627:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074636:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074644:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074652:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074658:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074663:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074671:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074683:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074692:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074698:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074703:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074709:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074714:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074723:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074736:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349858.074741:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1783349858.075438:0:12793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783349858.075442:0:12793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1783349858.076131:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349858.076135:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349858.076137:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783349858.076320:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f7d8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783349858.076330:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c90ac800/47d1b48f-2d78-45ee-b062-943ed61d9bed for MGS 00000020:00000080:2.0:1783349858.076415:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c90aa800 for MGS 00000020:01000000:0.0:1783349858.076683:0:12793:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320fb3027e0 - data ffff9320ec8566c0/ffff931fc6c26400 00000020:01000000:1.0:1783349858.077063:0:12793:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320c4fded80 - data ffff9320ec85fd80/ffff9320c798e800 00000020:00000080:1.0:1783349858.077528:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f1d 00000020:00000080:1.0:1783349858.077535:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c90ab800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783349858.077553:0:12793:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320c6fcb000 from MGS, refs=2 00000020:01000004:1.0:1783349858.077556:0:12793:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320c6fcb000 2 00000020:01000004:1.0:1783349858.077559:0:12793:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9320c6fcb000 from MGS 00000020:00000080:1.0:1783349858.077578:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349858.077584:0:12793:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783349858.077586:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320d0b2a000/MGS 00000020:00000080:1.0:1783349858.077588:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320d0b2a000/MGS for MGS 00000020:01000000:1.0:1783349858.077593:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783349858.077646:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783349858.077650:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349858.077656:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783349858.077662:0:12793:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9320fa58c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783349858.077668:0:12793:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9320d235cd40) has exports, disconnecting them 00000020:00080000:1.0:1783349858.077673:0:12793:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9320fa58c800), last request at 1783349709 00000020:00000080:1.0:1783349858.077687:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475fe8 00000020:00080000:1.0:1783349858.077696:0:12793:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9320fa58c800): rc 0 00000020:00000080:1.0:1783349858.077784:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320fa58c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783349858.077878:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c90ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783349858.077888:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fa58c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783349858.079180:0:12793:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783349858.079187:0:12793:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783349858.079192:0:12793:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783349858.079199:0:12793:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783349858.079306:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320fa58a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783349858.079399:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349858.079405:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783349858.079408:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320fa589000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783349858.079411:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fa589000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783349858.079419:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783349858.079463:0:12793:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320c6fcb000 1 00000020:00000080:0.0:1783349858.079467:0:12793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f0f 00000020:00000080:0.0:1783349858.079472:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320d0b29000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783349858.079483:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783349858.079486:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349858.079497:0:12793:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783349858.079500:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9320d22db380) has no exports 00000020:00000080:2.0:1783349858.079887:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9320d0b29000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783349858.093305:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349858.093320:0:12793:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783349858.093325:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c6fcc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783349858.093330:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c6fcc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783349858.093338:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783349858.093462:0:12793:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9320c6fcd800 00000020:01000000:0.0:1783349858.093482:0:12793:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1783349858.093486:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349858.093489:0:12793:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783349858.093492:0:12793:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9320c7268000) has no exports 00000100:00100000:2.0:1783349858.093733:0:5784:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9320d2390000:5784] 0 exiting: rc = 1 00000100:00100000:3.0:1783349858.093762:0:6605:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff931fc46e5a00:6605] 3 exiting: rc = 0 00000100:00100000:0.0:1783349858.094300:0:5785:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9320c75f5000:5785] 1 exiting: rc = 0 00000100:00100000:2.0:1783349858.094902:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9320c75f5200:5786] 2 exiting: rc = 0 00000100:00100000:0.0:1783349858.095030:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095037:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095042:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095047:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095052:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095063:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095070:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095087:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095092:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095100:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095105:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095110:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095126:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095133:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095138:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095142:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095148:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095153:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095158:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095164:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095169:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095192:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095197:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095205:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095209:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095214:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095221:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095226:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095231:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095236:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095241:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095249:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095255:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095259:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095264:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095269:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095274:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095278:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095283:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095287:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095292:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095296:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095300:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095304:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095309:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095314:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095321:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095327:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095331:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095336:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095341:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095345:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095350:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095355:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095360:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095365:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095374:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095379:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095383:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095388:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095393:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095398:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095416:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.095422:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101045:0:5787:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9320c75f5c00:5787] 0 exiting: rc = 1 00000100:00100000:2.0:1783349858.101255:0:5788:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9320d2391c00:5788] 1 exiting: rc = 0 00000100:00100000:0.0:1783349858.101320:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101327:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101334:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101339:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101391:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101397:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101402:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101408:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101413:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101418:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101423:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101427:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101433:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101438:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101446:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101450:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101455:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101460:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101465:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101470:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101474:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101478:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101483:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101487:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101491:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101495:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101509:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101514:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101518:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101523:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101527:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101532:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101536:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101540:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101545:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101549:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101553:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101558:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101562:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101567:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101571:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101575:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101579:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101584:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101587:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101592:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101596:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101600:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101605:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101609:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101613:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101618:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101623:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101627:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101632:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101636:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101640:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101644:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101649:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101654:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101660:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101671:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101684:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.101689:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.102284:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9320d2391800:5790] 1 exiting: rc = 0 00000100:00100000:2.0:1783349858.102413:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9320d2390800:5789] 0 exiting: rc = 1 00000100:00100000:0.0:1783349858.102483:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102489:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102494:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102499:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102510:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102515:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102520:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102526:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102531:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102536:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102542:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102548:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102553:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102559:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102564:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102573:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102589:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102595:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102601:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102607:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102613:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102617:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102623:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102629:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102635:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102641:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102646:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102651:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102669:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102684:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102691:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102696:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102708:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102715:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102720:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102726:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102731:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102739:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102745:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102750:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102767:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102773:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102779:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102784:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102812:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102818:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102824:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102829:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102835:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102839:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102845:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102850:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102868:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102873:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102881:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102886:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102891:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102897:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102901:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102907:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102913:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102918:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102924:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.102930:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109478:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9320c7603800:5792] 1 exiting: rc = 0 00000100:00100000:2.0:1783349858.109591:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9320d2391200:5791] 0 exiting: rc = 1 00000100:00100000:0.0:1783349858.109672:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109688:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109705:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109710:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109716:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109722:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109727:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109736:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109743:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109750:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109755:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109759:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109764:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109771:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109776:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109780:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109784:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109787:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109860:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109866:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109870:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109874:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109878:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109882:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109886:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109893:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109898:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109902:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109908:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109912:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109917:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109921:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109926:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109931:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109936:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109941:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109946:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109959:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109964:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109969:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109978:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109982:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109987:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109992:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.109997:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110001:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110006:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110011:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110017:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110021:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110026:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110034:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110041:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110048:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110053:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110057:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110062:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110068:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110073:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110077:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110081:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110086:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110090:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110097:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.110516:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9320c6c76600:5794] 1 exiting: rc = 0 00000100:00100000:3.0:1783349858.110524:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9320c9027e00:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1783349858.110580:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110585:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110590:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110594:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110599:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110605:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110609:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110614:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110625:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110630:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110635:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110639:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110644:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110649:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110654:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110659:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110664:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110669:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110685:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110690:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110695:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110700:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110706:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110711:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110716:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110721:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110726:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110730:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110735:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110739:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110744:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110748:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110753:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110757:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110762:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110767:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110771:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110775:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110780:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110784:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110788:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110809:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110814:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110827:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110831:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110836:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110841:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110845:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110850:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110859:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110865:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110876:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110880:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110885:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110890:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110894:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110902:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110907:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110911:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110916:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110920:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110924:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110929:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.110935:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111295:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9320c6c76c00:5796] 1 exiting: rc = 0 00000100:00100000:2.0:1783349858.111464:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9320c9026a00:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1783349858.111602:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111608:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111613:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111618:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111623:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111628:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111632:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111637:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111642:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111647:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111653:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111659:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111664:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111687:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111693:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111699:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111705:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111711:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111716:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111721:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111740:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111745:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111753:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111757:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111762:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111766:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111810:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111816:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111820:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111825:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111829:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111833:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111838:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111842:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111847:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111851:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111855:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111858:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111863:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111867:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111871:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111875:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111879:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111883:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111887:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111891:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111895:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111899:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111910:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111914:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111919:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111923:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111927:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111932:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111937:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111942:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111947:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111952:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111957:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111962:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111967:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111972:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111976:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783349858.111981:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.112625:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9320ec7c3000:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1783349858.112957:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9320ec7c2600:5799] 2 exiting: rc = 0 00000100:00100000:0.0:1783349858.113363:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9320ec7c3a00:5798] 1 exiting: rc = 0 00000100:00100000:2.0:1783349858.113443:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113449:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113455:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113460:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113465:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113470:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113475:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113480:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113485:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113489:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113495:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113499:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113509:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113515:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113520:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113525:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113531:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113537:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113542:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113550:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113555:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113562:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113568:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113573:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113580:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113587:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113608:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113615:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113621:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113634:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113639:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113644:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113650:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113655:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113661:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113667:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113682:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113693:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113701:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113706:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113714:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113720:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113725:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113733:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113739:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113744:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113750:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113754:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113759:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113767:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113785:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113825:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113832:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113837:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113842:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113847:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113853:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113858:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113863:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113867:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113873:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113877:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113882:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349858.113892:0:12793:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783349858.133357:0:12793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349858.133372:0:12793:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783349858.133378:0:12793:0:(genops.c:906:class_export_put()) final put ffff9320c7409800/MDS_uuid 00000020:00000080:0.0:1783349858.133383:0:12793:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c7409800/MDS_uuid for MDS 00000020:01000000:0.0:1783349858.133398:0:12793:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783349858.133605:0:12793:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1783349858.727018:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783349858.727025:0:7491:0:(genops.c:906:class_export_put()) final put ffff9320c86b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783349858.727082:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c86b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783349858.727143:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c86b1800 for lustre-OST0001 00010000:00010000:0.0:1783349858.985992:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349860.010174:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783349860.515406:0:12949:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783349860.544160:0:12949:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1783349860.544220:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349860.544236:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349860.544244:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349860.544251:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349860.544279:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783349860.544284:0:12949:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783349860.544318:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349860.544324:0:12949:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783349860.544331:0:12949:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783349860.544338:0:12949:0:(import.c:65:import_set_state_nolock()) ffff931fc4706800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1783349860.544343:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349860.544344:0:12949:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783349860.544347:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783349860.545836:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349860.545854:0:7481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.545866:0:7481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349860.545871:0:7481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.545900:0:7481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349860.545907:0:7481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349860.545912:0:7481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349860.545915:0:7481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783349860.545918:0:7481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783349860.545959:0:7481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.545965:0:7481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349860.545998:0:7481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.546005:0:7481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051c00/0x68b4a22a48476250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476257 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349860.546018:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349860.546020:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349860.546022:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349860.546031:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349860.546050:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666788224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349860.546122:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349860.546180:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666788224 00000100:00100000:0.0:1783349860.546187:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666788224 00000100:00100000:0.0:1783349860.548230:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783349860.548243:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c78ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3291:x1869977666788224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783349860.548269:0:5769:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349860 with bad export cookie 7544833578237386553 00010000:00010000:1.0:1783349860.550335:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550368:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550376:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550398:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550430:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349860.550439:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550445:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550452:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550458:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550473:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783349860.550478:0:12949:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783349860.550511:0:12949:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783349860.550520:0:12949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1783349860.550533:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349860.550538:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550547:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051a00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349860.550550:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550559:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349860.550572:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349860.550578:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783349860.550580:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1783349860.550582:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1783349860.550637:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550645:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349860.550671:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550678:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff932102051a00/0x68b4a22a4847625e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a48476265 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550696:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349860.550699:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550704:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175a000 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349860.550707:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550714:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349860.550720:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349860.550736:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783349860.550738:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783349860.550740:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783349860.550754:0:5773:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550760:0:5773:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349860.550767:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550772:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d175a000/0x68b4a22a48476495 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x68b4a22a4847649c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349860.550781:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349860.550783:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349860.550785:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783349860.550816:0:12949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349860.550823:0:12949:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783349860.550828:0:12949:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9320f7d919c0) has no exports 00000020:00080000:1.0:1783349860.550855:0:12949:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9320f7d919c0) has no exports 00010000:00010000:3.0:1783349860.550982:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349860.551014:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666788480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349860.551086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349860.551128:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349860.551136:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666788352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349860.551165:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349860.551203:0:12794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666788480 00000100:00100000:3.0:1783349860.551210:0:12794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666788480 00000100:00100000:3.0:1783349860.551235:0:12794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666788352 00000100:00100000:3.0:1783349860.551238:0:12794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666788352 00000100:00100000:3.0:1783349860.551252:0:12794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349860.551261:0:12794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3294:x1869977666788480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783349860.551269:0:12794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349860 with bad export cookie 7544833578237386553 00000100:00100000:3.0:1783349860.551319:0:12794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3294:x1869977666788480:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (232us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783349860.551327:0:12794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349860.551349:0:12794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349860.551353:0:12794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3294:x1869977666788352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783349860.551357:0:12794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783349860 with bad export cookie 7544833578237386553 00000100:00100000:3.0:1783349860.551382:0:12794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3294:x1869977666788352:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (216us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783349860.551387:0:12794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783349860.551428:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783349860.551433:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9320c53d3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783349860.551437:0:3294:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:1.0:1783349860.558087:0:12949:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320fb302180 - data ffff931fc49030d8/ffff931fc469b400 00000020:01000000:1.0:1783349860.558312:0:12949:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320e5f6bd80 - data ffff931fc49d36c0/ffff931fc4dd3000 00000100:00100000:0.0:1783349860.571057:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c78ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3291:x1869977666788224:12345-0@lo:103:ldlm_bl.0 Request processed in 22806us (24927us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783349860.571073:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783349860.571237:0:3291:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783349860.592463:0:3294:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.136@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783349860.592470:0:3294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783349860.592518:0:3294:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9320e40ab100 x1869977666788224/t0(0) o103->MGC192.168.204.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349876 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349860.592533:0:3294:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9320de7a8380 x1869977666788480/t0(0) o103->MGC192.168.204.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349876 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349860.592665:0:3294:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9320de7a8e00 x1869977666788352/t0(0) o103->MGC192.168.204.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783349876 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783349860.592675:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783349860.592678:0:3294:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783349860.592679:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783349860.594203:0:3291:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9320c53d3000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1783349860.594232:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47d1b48f-2d78-45ee-b062-943ed61d9bed:3291:1869977666788224:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783349860.595728:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9320c53d3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783349860.595742:0:3294:0:(import.c:512:import_select_connection()) MGC192.168.204.136@tcp: connect to NID 0@lo last attempt 96 00000100:00080000:3.0:1783349860.595755:0:3294:0:(import.c:626:import_select_connection()) MGC192.168.204.136@tcp: import ffff9320c53d3000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:3.0:1783349860.596002:0:3294:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320d6a89500 x1869977666788608/t0(0) o250->MGC192.168.204.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783349860.596056:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666788480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349860.596079:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47d1b48f-2d78-45ee-b062-943ed61d9bed:3294:1869977666788352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349860.596686:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47d1b48f-2d78-45ee-b062-943ed61d9bed:3290:1869977666788608:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1783349860.596739:0:3290:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869977666788608 offset 0 length 520: 4 00100000:10000000:0.0:1783349860.613975:0:12949:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783349860.650851:0:12949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a4847606d 00000020:00000080:3.0:1783349860.650862:0:12949:0:(genops.c:906:class_export_put()) final put ffff931fc4777000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783349860.650884:0:12949:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320f70f3800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783349860.650888:0:12949:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320f70f3800 2 00000020:01000004:3.0:1783349860.650891:0:12949:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9320f70f3800 from lustre-OST0000 00000020:00000080:3.0:1783349860.650921:0:12949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783349860.650947:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783349860.650951:0:12949:0:(genops.c:906:class_export_put()) final put ffff931fc4776800/lustre-OST0000_UUID 00000020:00000080:3.0:1783349860.650954:0:12949:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc4776800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783349860.650962:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783349860.651008:0:12949:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783349860.651014:0:12949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783349860.651018:0:12949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783349860.651023:0:12949:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783349860.651030:0:12949:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff931fc4700800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783349860.651036:0:12949:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9320c75eb380) has exports, disconnecting them 00000020:00080000:3.0:1783349860.651042:0:12949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff931fc4700800), last request at 1783349719 00000020:00000080:3.0:1783349860.651046:0:12949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476097 00000020:00080000:3.0:1783349860.651055:0:12949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff931fc4700800): rc 0 00000020:00000080:3.0:1783349860.651060:0:12949:0:(genops.c:906:class_export_put()) final put ffff931fc4700800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783349860.651676:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc4777000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783349860.651689:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc4700800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1783349860.662950:0:12949:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783349860.662961:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349860.662966:0:12949:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783349860.662974:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783349860.663161:0:12949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783349860.663187:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1783349860.663201:0:12949:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320f70f3800 1 00000020:00000080:1.0:1783349860.663208:0:12949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476027 00000020:00000080:1.0:1783349860.663217:0:12949:0:(genops.c:906:class_export_put()) final put ffff9320f70f2800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783349860.663229:0:12949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783349860.663234:0:12949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783349860.663238:0:12949:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783349860.663242:0:12949:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9320c726cd40) has no exports 00000020:00000080:3.0:1783349860.663748:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff931fc4706800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783349860.663758:0:8:0:(genops.c:906:class_export_put()) final put ffff931fc4703800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783349860.663761:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff931fc4703800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783349860.663768:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783349860.663871:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f70f2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783349860.677448:0:12949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783349860.677465:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783349860.677472:0:12949:0:(genops.c:906:class_export_put()) final put ffff9320f70f1800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783349860.677478:0:12949:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f70f1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783349860.677490:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783349860.677723:0:12949:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9320f70f2000 00000020:02000400:3.0:1783349860.677778:0:12949:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1783349861.033975:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783349861.225846:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 47d1b48f-2d78-45ee-b062-943ed61d9bed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349861.225854:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 47d1b48f-2d78-45ee-b062-943ed61d9bed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783349861.225857:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783349861.225860:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783349861.225864:0:8:0:(import.c:65:import_set_state_nolock()) ffff9320c86b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349861.225872:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 243 00000100:00080000:0.0:1783349861.225879:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783349861.225886:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9320c86b0000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:0.0:1783349861.225922:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320e40a9c00 x1869977666788736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349861.226391:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666788736:0@lo:38:kworker.0 00000400:00000100:1.0:1783349861.226440:0:3290:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869977666788736 offset 0 length 520: 4 00010000:00010000:2.0:1783349862.068019:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783349862.930537:0:13098:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783349862.938026:0:13098:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783349862.938102:0:13098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.938123:0:13098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.938131:0:13098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.938138:0:13098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.938203:0:13098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783349862.938211:0:13098:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783349862.938234:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349862.938244:0:13098:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9320e40a9c00 x1869977666788736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349876 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349862.938259:0:13098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783349862.938266:0:13098:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783349862.938272:0:13098:0:(import.c:65:import_set_state_nolock()) ffff9320c86b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783349862.938276:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783349862.938279:0:13098:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9320e40a9c00 x1869977666788736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783349876 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349862.938286:0:13098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783349862.938289:0:13098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1783349862.938376:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666788736:0@lo:38:kworker.0 00010000:00010000:0.0:1783349862.938679:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349862.938686:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349862.938694:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349862.938698:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349862.938718:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349862.938726:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349862.938732:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349862.938735:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783349862.938737:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783349862.938912:0:5772:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9320c53d3000 00010000:00010000:0.0:1783349862.938918:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349862.938999:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c9003c00/0x68b4a22a48476234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a4847623b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349862.939013:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349862.939015:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349862.939017:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349862.940485:0:13098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940501:0:13098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940523:0:13098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940530:0:13098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940555:0:13098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349862.940562:0:13098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940569:0:13098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940575:0:13098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940582:0:13098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349862.940608:0:13098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783349862.940613:0:13098:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783349862.940636:0:13098:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783349862.940641:0:13098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783349862.940645:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349862.940650:0:13098:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783349862.940654:0:13098:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9320d23599c0) has no exports 00000020:00080000:2.0:1783349862.940676:0:13098:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9320d23599c0) has no exports 00010000:00010000:1.0:1783349862.941042:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349862.941060:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941073:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320d175b400 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349862.941077:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941086:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349862.941093:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349862.941107:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783349862.941110:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1783349862.941112:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1783349862.941124:0:5773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9320c53d3000 00010000:00010000:1.0:1783349862.941127:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941142:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320d175b400/0x68b4a22a48476242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a48476249 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941157:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349862.941160:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941167:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96a00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349862.941170:0:5773:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941177:0:5773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349862.941183:0:5773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349862.941188:0:5773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783349862.941200:0:5773:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783349862.941206:0:5773:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783349862.941221:0:5773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9320c53d3000 00010000:00010000:1.0:1783349862.941224:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941231:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48476487 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a4847648e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349862.941256:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349862.941258:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349862.941264:0:5773:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783349862.942382:0:13098:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320c4b252a0 - data ffff931fc4a7b360/ffff9320fb4ec000 00000020:01000000:2.0:1783349862.942528:0:13098:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9320fb7345a0 - data ffff9320ecb90438/ffff931fc4552400 00010000:00010000:0.0:1783349862.942645:0:7481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783349862.967144:0:13098:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783349863.004162:0:13098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476138 00000020:00000080:0.0:1783349863.004173:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320f77de000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783349863.004194:0:13098:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320c970f800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783349863.004198:0:13098:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320c970f800 2 00000020:01000004:0.0:1783349863.004201:0:13098:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9320c970f800 from lustre-OST0001 00000020:00000080:0.0:1783349863.004226:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349863.004237:0:13098:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783349863.004240:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320fb53a800/lustre-OST0001_UUID 00000020:00000080:0.0:1783349863.004243:0:13098:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fb53a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783349863.004250:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1783349863.004416:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f77de000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1783349863.004576:0:13098:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 47d1b48f-2d78-45ee-b062-943ed61d9bed->MGS 00010000:00010000:0.0:1783349863.004600:0:13098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349863.004612:0:13098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349863.004619:0:13098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783349863.004621:0:13098:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783349863.004623:0:13098:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783349863.004635:0:13098:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9320c53d3000 00010000:00010000:0.0:1783349863.004639:0:13098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a4847604a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a48476051 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349863.004653:0:13098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349863.004660:0:13098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349863.004664:0:13098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783349863.004666:0:13098:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783349863.004668:0:13098:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783349863.004674:0:13098:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9320c53d3000 00010000:00010000:0.0:1783349863.004676:0:13098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320faacae00/0x68b4a22a48476288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x68b4a22a4847628f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783349863.004689:0:13098:0:(import.c:65:import_set_state_nolock()) ffff9320c53d3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783349863.004692:0:13098:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783349863.004694:0:13098:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783349863.004696:0:13098:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783349863.004699:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783349863.004714:0:13098:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9320d6a89500 x1869977666788608/t0(0) o250->MGC192.168.204.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783349870 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783349863.004732:0:13098:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783349863.004735:0:13098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1783349863.004978:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47d1b48f-2d78-45ee-b062-943ed61d9bed:3290:1869977666788608:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:0.0:1783349863.005030:0:13098:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783349863.005037:0:13098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48475f2b 00000020:00000080:0.0:1783349863.005042:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320c740a000/47d1b48f-2d78-45ee-b062-943ed61d9bed 00000020:01000000:0.0:1783349863.005057:0:13098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.136@tcp (flags='') 00000020:00000080:0.0:1783349863.005062:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349863.005066:0:13098:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.136@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783349863.005070:0:13098:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9320c75e8000) has no exports 00000020:00000080:1.0:1783349863.005094:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c740a000/47d1b48f-2d78-45ee-b062-943ed61d9bed for MGC192.168.204.136@tcp 10000000:01000000:1.0:1783349863.005137:0:5781:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783349863.005168:0:13098:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.136@tcp: client import never connected 00000100:00080000:0.0:1783349863.005170:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783349863.005172:0:13098:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783349863.005174:0:13098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783349863.005175:0:13098:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783349863.005229:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c53d3000 for MGC192.168.204.136@tcp 00000020:00000080:0.0:1783349863.005350:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783349863.005357:0:13098:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.136@tcp (uuid 47d1b48f-2d78-45ee-b062-943ed61d9bed) 00000020:00000080:0.0:1783349863.005360:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320c53d6800/47d1b48f-2d78-45ee-b062-943ed61d9bed 00000020:00000080:0.0:1783349863.005362:0:13098:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c53d6800/47d1b48f-2d78-45ee-b062-943ed61d9bed for MGC192.168.204.136@tcp 00000020:01000000:0.0:1783349863.005368:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.136@tcp (47d1b48f-2d78-45ee-b062-943ed61d9bed) 00000020:01000000:0.0:1783349863.005650:0:13098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783349863.005653:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783349863.005657:0:13098:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783349863.005661:0:13098:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9320c86b5000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783349863.005666:0:13098:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9320d2358000) has exports, disconnecting them 00000020:00080000:0.0:1783349863.005669:0:13098:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9320c86b5000), last request at 1783349729 00000020:00000080:0.0:1783349863.005673:0:13098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476162 00000020:00080000:0.0:1783349863.005682:0:13098:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9320c86b5000): rc 0 00000020:00000080:0.0:1783349863.005686:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320c86b5000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783349863.005905:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c86b5000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1783349863.011861:0:13098:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1783349863.011871:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783349863.011876:0:13098:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783349863.011884:0:13098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783349863.012055:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320c86b0000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1783349863.012861:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783349863.014120:0:5773:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783349863.014293:0:7481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1783349863.014513:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9320c7946800:5768] 1 exiting: rc = 0 00000100:00100000:2.0:1783349863.014595:0:5767:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9320c7947800:5767] 0 exiting: rc = 1 00000100:00100000:1.0:1783349863.014674:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.015115:0:12794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff931fc789d600:12794] 3 exiting: rc = 0 00000100:00100000:2.0:1783349863.015185:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9320c7947000:5771] 2 exiting: rc = 0 00000100:00100000:2.0:1783349863.015231:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9320c7946c00:5770] 1 exiting: rc = 0 00000100:00100000:1.0:1783349863.027144:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9320c7946a00:5769] 0 exiting: rc = 1 00000100:00100000:2.0:1783349863.027310:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027318:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027324:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027329:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027336:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027342:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027347:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027352:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027358:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027364:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027370:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027375:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027381:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027388:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027394:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027399:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027405:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027411:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027416:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027420:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027425:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027430:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027435:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027451:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027456:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027461:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027467:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027472:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027477:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027482:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027488:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027492:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027498:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027503:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027508:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027512:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027517:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027522:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027638:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027644:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027648:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027653:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027659:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027664:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027669:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027674:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027679:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027683:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027688:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027693:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027698:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027703:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027707:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027712:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027718:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027723:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027728:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027732:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027744:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027749:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027754:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027759:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027764:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.027769:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783349863.031152:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349863.031166:0:13098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783349863.031174:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320f77db000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783349863.031180:0:13098:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f77db000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783349863.031191:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1783349863.031267:0:13098:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320c970f800 1 00000020:00000080:2.0:1783349863.031348:0:13098:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48476107 00000020:00000080:2.0:1783349863.031356:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320fb53b800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783349863.031372:0:13098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783349863.031377:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349863.031382:0:13098:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783349863.031385:0:13098:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9320c79dcd40) has no exports 00000020:00000080:1.0:1783349863.031472:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fb53b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783349863.047703:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349863.047718:0:13098:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783349863.047723:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320c9709000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783349863.047729:0:13098:0:(genops.c:865:class_export_destroy()) destroying export ffff9320c9709000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783349863.047735:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783349863.048556:0:13098:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9320c9709800 00000020:01000000:2.0:1783349863.048578:0:13098:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783349863.048592:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783349863.048597:0:13098:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783349863.048600:0:13098:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9320c72699c0) has no exports 00000020:00000080:2.0:1783349863.048624:0:13098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783349863.048633:0:13098:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783349863.048637:0:13098:0:(genops.c:906:class_export_put()) final put ffff9320f70f3000/OSS_uuid 00000020:00000080:2.0:1783349863.048639:0:13098:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f70f3000/OSS_uuid for OSS 00000020:01000000:2.0:1783349863.048643:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783349863.048845:0:6580:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9320fd672600:6580] 2 exiting: rc = 0 00000100:00100000:0.0:1783349863.048945:0:7807:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9320fb6fbc00:7807] 3 exiting: rc = 0 00000100:00100000:0.0:1783349863.048999:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9320c5084800:6578] 0 exiting: rc = 1 00000100:00080000:1.0:1783349863.060937:0:5780:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783349863.061126:0:11848:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9320c6796a00:11848] 4 exiting: rc = 0 00000100:00100000:1.0:1783349863.061195:0:6579:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9320f72d7800:6579] 1 exiting: rc = 0 00000100:00100000:2.0:1783349863.061919:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061931:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061938:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061943:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061948:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061955:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061962:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061967:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061972:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061978:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061984:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061989:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.061995:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062000:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062005:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062010:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062015:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062019:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062024:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062029:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062034:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062041:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062046:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062052:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062057:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062062:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062067:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062073:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062078:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062085:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062090:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062096:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062102:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062107:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062113:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062134:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062139:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062145:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062151:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062156:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062161:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062167:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062172:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062177:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062182:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062187:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062192:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062197:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062201:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062206:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062211:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062215:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062220:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062225:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062230:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062234:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062239:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062243:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062247:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062252:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062256:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062261:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062266:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.062271:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066359:0:8312:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9320fabaa600:8312] 2 exiting: rc = 0 00000100:00100000:3.0:1783349863.066535:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9320f72d9a00:6583] 1 exiting: rc = 0 00000100:00100000:1.0:1783349863.066776:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9320fd672a00:6582] 0 exiting: rc = 1 00000100:00100000:2.0:1783349863.066904:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066911:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066916:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066922:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066928:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066947:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066951:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066956:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066961:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066965:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066970:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066975:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066979:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066983:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066987:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066993:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.066997:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067001:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067006:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067010:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067016:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067020:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067025:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067029:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067034:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067039:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067043:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067049:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067053:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067058:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067062:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067066:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067072:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067077:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067082:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067086:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067112:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067118:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067123:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067128:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067139:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067143:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067147:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067152:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067157:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067161:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067166:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067171:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067176:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067308:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067314:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067319:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067324:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067329:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067334:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067338:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067342:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067348:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067353:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067358:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067363:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067368:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067373:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.067384:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349863.069217:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9320fa574000:6584] 0 exiting: rc = 1 00000100:00100000:1.0:1783349863.069632:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9320fa574e00:6586] 2 exiting: rc = 0 00000100:00100000:0.0:1783349863.070042:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9320fa575800:6585] 1 exiting: rc = 0 00000100:00100000:2.0:1783349863.070279:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070289:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070294:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070300:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070306:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070312:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070317:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070323:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070328:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070333:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070338:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070417:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070426:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070453:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070459:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070465:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070470:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070475:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070480:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070484:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070489:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070498:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070504:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070509:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070516:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070521:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070526:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070532:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070538:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070543:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070548:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070554:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070560:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070565:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070570:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070575:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070590:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070613:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070619:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070624:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070629:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070634:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070638:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070644:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070651:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070656:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070666:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070671:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070676:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070681:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070687:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070692:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070728:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070743:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070749:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070753:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070759:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070764:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070769:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070773:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070778:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070784:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070897:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.070905:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349863.076493:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9320d23cca00:6587] 0 exiting: rc = 1 00000100:00100000:3.0:1783349863.078087:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9320d23cc800:6588] 1 exiting: rc = 0 00000100:00100000:2.0:1783349863.079599:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079608:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079613:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079618:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079623:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079628:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079633:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079638:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079643:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079648:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079653:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079662:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079667:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079673:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079679:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079685:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079690:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079711:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079716:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079721:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079726:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079731:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079739:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079743:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079748:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079753:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079758:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079762:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079767:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079771:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079776:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079780:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079785:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079790:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079861:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079865:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079870:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079874:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079879:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079883:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079887:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079891:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079895:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079899:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079904:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079908:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079912:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079916:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.079920:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080044:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080049:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080054:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080067:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080072:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080076:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080081:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080086:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080091:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080096:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080101:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080106:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080111:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080116:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.080120:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783349863.081250:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9320fa5b9600:6589] 0 exiting: rc = 1 00000100:00100000:1.0:1783349863.081354:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9320fa5b9000:6590] 1 exiting: rc = 0 00000100:00100000:2.0:1783349863.081431:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081440:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081447:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081454:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081461:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081467:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081473:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081478:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081484:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081501:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081508:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081513:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081519:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081524:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081530:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081536:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081542:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081549:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081554:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081559:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081564:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081594:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081601:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081616:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081622:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081627:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081633:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081639:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081645:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081652:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081657:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081662:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081673:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081705:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081717:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081726:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081737:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081746:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081757:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081766:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081778:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081788:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081894:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081903:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081914:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081940:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081947:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081953:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081958:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081964:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081970:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081975:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081982:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081988:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.081997:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082009:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082018:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082048:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082061:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082067:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082073:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082079:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082084:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783349863.082101:0:13098:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1783349863.096081:0:13098:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783349875.364564:0:13709:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1783349880.038991:0:14121:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783349880.038995:0:14121:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1783349880.039111:0:14121:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9320f7b31800 00000020:01000004:0.0:1783349880.039124:0:14121:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783349880.039131:0:14121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783349880.039143:0:14121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9320f7d93380) 00000020:00000080:0.0:1783349880.039156:0:14121:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783349880.054616:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783349880.056368:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1783349880.056768:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783349880.056859:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1783349880.056955:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1783349880.057041:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1783349880.057126:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1783349880.057249:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1783349880.057360:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1783349880.057586:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1783349880.058678:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 591: rc = 0 00100000:10000000:0.0:1783349880.058762:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 591: rc = 0 00100000:10000000:0.0:1783349880.059175:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:0.0:1783349880.059616:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:0.0:1783349880.060047:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1783349880.060302:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1783349880.060537:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:0.0:1783349880.060765:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1783349880.061030:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:0.0:1783349880.061275:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1783349880.061505:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:0.0:1783349880.061737:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1783349880.062144:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 770: rc = 0 00100000:10000000:0.0:1783349880.062405:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:0.0:1783349880.062786:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 792: rc = 0 00100000:10000000:0.0:1783349880.063051:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 792: rc = 0 00100000:10000000:0.0:1783349880.063304:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 792: rc = 0 00100000:10000000:0.0:1783349880.063530:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 792: rc = 0 00100000:10000000:0.0:1783349880.063760:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 792: rc = 0 00100000:10000000:0.0:1783349880.064437:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 792: rc = 0 00100000:10000000:0.0:1783349880.064676:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 792: rc = 0 00100000:10000000:0.0:1783349880.064927:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 792: rc = 0 00100000:10000000:0.0:1783349880.065165:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 792: rc = 0 00100000:10000000:0.0:1783349880.067754:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 792: rc = 0 00100000:10000000:0.0:1783349880.068100:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 792: rc = 0 00100000:10000000:0.0:1783349880.068357:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 792: rc = 0 00100000:10000000:0.0:1783349880.068596:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 792: rc = 0 00100000:10000000:0.0:1783349880.068940:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 792: rc = 0 00100000:10000000:0.0:1783349880.069183:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 792: rc = 0 00100000:10000000:0.0:1783349880.069444:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 792: rc = 0 00100000:10000000:0.0:1783349880.069697:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 792: rc = 0 00100000:10000000:0.0:1783349880.069981:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 792: rc = 0 00100000:10000000:0.0:1783349880.070231:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 792: rc = 0 00100000:10000000:0.0:1783349880.070493:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 792: rc = 0 00100000:10000000:0.0:1783349880.070741:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 792: rc = 0 00100000:10000000:0.0:1783349880.071102:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 792: rc = 0 00100000:10000000:0.0:1783349880.071362:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 792: rc = 0 00100000:10000000:0.0:1783349880.071626:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 792: rc = 0 00100000:10000000:0.0:1783349880.072147:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 792: rc = 0 00100000:10000000:0.0:1783349880.072431:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 792: rc = 0 00100000:10000000:0.0:1783349880.072856:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 792: rc = 0 00100000:10000000:0.0:1783349880.073123:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 792: rc = 0 00100000:10000000:0.0:1783349880.073382:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 792: rc = 0 00100000:10000000:0.0:1783349880.073642:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 792: rc = 0 00100000:10000000:0.0:1783349880.073863:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 792: rc = 0 00100000:10000000:0.0:1783349880.074078:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 792: rc = 0 00100000:10000000:0.0:1783349880.074383:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 282: rc = 0 00100000:10000000:0.0:1783349880.075064:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1783349880.075228:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 276: rc = 0 00100000:10000000:0.0:1783349880.075424:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1783349880.075484:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 276: rc = 0 00100000:10000000:0.0:1783349880.075655:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1783349880.075719:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 276: rc = 0 00100000:10000000:2.0:1783349880.076373:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1783349880.076444:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:2.0:1783349880.076639:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1783349880.076708:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:2.0:1783349880.076966:0:14121:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1783349880.077033:0:14121:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00000020:00000080:2.0:1783349880.077277:0:14121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783349880.077285:0:14121:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783349880.077294:0:14121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a4847722c 00000020:01000004:2.0:1783349880.077301:0:14121:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783349880.077305:0:14121:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783349880.077310:0:14121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9320f7b31800 from MGS 00000020:01000004:2.0:1783349880.077314:0:14121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783349880.077322:0:14121:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9320c79dcd40) 00000020:00000080:2.0:1783349880.077330:0:14121:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783349880.077378:0:14121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320f7b31800 from MGS, refs=2 00080000:01000000:2.0:1783349880.077382:0:14121:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783349880.077386:0:14121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a4847723a 00000100:00100000:2.0:1783349880.077471:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783349880.077573:0:14121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783349880.077579:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783349880.078129:0:14121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783349880.078135:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783349880.078713:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349880.081359:0:14121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783349880.081379:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783349880.082066:0:14121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783349880.082075:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783349880.082732:0:14121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783349880.082738:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783349880.083880:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349880.083884:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349880.083886:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349880.084399:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349880.084402:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349880.084404:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349880.084944:0:14121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783349880.087748:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783349880.093212:0:14121:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1783349880.093231:0:14121:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783349880.093234:0:14121:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783349880.096647:0:14130:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783349880.097917:0:14121:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783349880.098035:0:14121:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783349880.098649:0:14121:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783349880.098960:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783349880.099110:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783349880.099116:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783349880.100021:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783349880.100029:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783349880.100883:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783349880.100890:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783349880.102095:0:14121:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783349880.102117:0:14121:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.136@tcp' 00000020:01000004:1.0:1783349880.102119:0:14121:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783349880.102148:0:14121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.136@tcp (typ=mgc) 00000020:00000080:1.0:1783349880.102161:0:14121:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.136@tcp (ffff9320d235b380) 00000020:00000080:1.0:1783349880.102182:0:14121:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783349880.102256:0:14121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320e023f800@MGC192.168.204.136@tcp: add connection 192.168.204.136@tcp at head 00010000:00010000:1.0:1783349880.102413:0:14121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.136@tcp-0 is initialized 00000040:01000000:1.0:1783349880.102419:0:14121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783349880.102736:0:14135:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783349880.107507:0:14136:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783349880.107669:0:14121:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.136@tcp (uuid 5c03eaf5-3c01-4bdb-85d5-7a85e51946c8) 00000020:00000080:3.0:1783349880.107691:0:14121:0:(genops.c:1406:class_connect()) connect: client 5c03eaf5-3c01-4bdb-85d5-7a85e51946c8, cookie 0x68b4a22a48477248 00000100:00080000:3.0:1783349880.107704:0:14121:0:(import.c:512:import_select_connection()) MGC192.168.204.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783349880.107710:0:14121:0:(import.c:626:import_select_connection()) MGC192.168.204.136@tcp: import ffff9320e023f800 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:3.0:1783349880.107740:0:14121:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320d6a88000 x1869977666788864/t0(0) o250->MGC192.168.204.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349880.107827:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3290:1869977666788864:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783349880.107890:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349880.107989:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666788864 00000100:00100000:0.0:1783349880.107997:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666788864 00000100:00100000:0.0:1783349880.108029:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349880.108036:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1869977666788864:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783349880.108057:0:14132:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5c03eaf5-3c01-4bdb-85d5-7a85e51946c8@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1783349880.108080:0:14132:0:(genops.c:1406:class_connect()) connect: client 5c03eaf5-3c01-4bdb-85d5-7a85e51946c8, cookie 0x68b4a22a4847724f 00000100:00080000:0.0:1783349880.108199:0:14132:0:(import.c:65:import_set_state_nolock()) ffff9320f7b33800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783349880.108293:0:14121:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 5c03eaf5-3c01-4bdb-85d5-7a85e51946c8->MGS 00000020:01000004:3.0:1783349880.108311:0:14121:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783349880.108316:0:14121:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783349880.108329:0:14121:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9320c75eb380) 00000020:00000080:3.0:1783349880.108340:0:14121:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783349880.111675:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+5:3290:x1869977666788864:12345-0@lo:250:mount.lustre.0 Request processed in 3628us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349880.111756:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349880.115385:0:3290:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783349880.115399:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.136@tcp: connect to target with instance 0 00000100:00080000:1.0:1783349880.115408:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783349880.115414:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783349880.115419:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320e023f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783349880.115422:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783349880.115437:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783349880.115447:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3290:1869977666788864:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783349880.121414:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349880.121571:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783349880.121577:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783349880.122530:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783349880.122537:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783349880.123094:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783349880.123100:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783349880.124087:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783349880.124323:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783349880.124329:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783349880.125256:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783349880.125273:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783349880.154067:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349880.154736:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783349880.154743:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783349880.156994:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783349880.157008:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783349880.157763:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349880.158061:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783349880.158066:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783349880.158532:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783349880.158538:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783349880.160570:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349880.160771:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783349880.160777:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783349880.161492:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783349880.161500:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783349880.162279:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349880.162411:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783349880.162417:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783349880.163011:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783349880.163018:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783349880.179974:0:14121:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349880.180155:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349880.180162:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783349880.181688:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783349880.181697:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783349880.182566:0:14121:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783349880.182575:0:14121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783349880.183496:0:14121:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783349880.183517:0:14121:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783349880.183524:0:14121:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783349880.183710:0:14121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783349880.183745:0:14121:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.136@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783349880.183749:0:14121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783349880.183751:0:14121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783349880.183752:0:14121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783349880.183753:0:14121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783349880.183755:0:14121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783349880.183756:0:14121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783349880.183757:0:14121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783349880.183759:0:14121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783349880.183761:0:14121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783349880.183763:0:14121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783349880.183766:0:14121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783349880.183768:0:14121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783349880.183773:0:14121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783349880.183774:0:14121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783349880.183775:0:14121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783349880.183776:0:14121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783349880.183777:0:14121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783349880.183778:0:14121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783349880.183779:0:14121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783349880.183780:0:14121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783349880.183781:0:14121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783349880.184050:0:14121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783349880.184071:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666788992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783349880.184141:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349880.184301:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c68530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.184353:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666788992 00000100:00100000:3.0:1783349880.184361:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666788992 00000100:00100000:3.0:1783349880.184440:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349880.184448:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+5:14121:x1869977666788992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783349880.184491:0:14134:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783349880.184494:0:14134:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783349880.184496:0:14134:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783349880.184827:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783349880.185245:0:14134:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1783349880.186154:0:14156:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783349880.186160:0:14156:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783349880.186163:0:14156:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783349880.186284:0:14156:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783349880.186507:0:14134:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783349880.186517:0:14134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783349880.197065:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+5:14121:x1869977666788992:12345-0@lo:253:mount.lustre.0 Request processed in 12608us (12913us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349880.197086:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349880.197102:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666788992:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783349880.197120:0:14121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783349880.197124:0:14121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349880.197127:0:14121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349880.197128:0:14121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349880.197144:0:14121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349880.197145:0:14121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349880.197146:0:14121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349880.197148:0:14121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349880.197149:0:14121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349880.197151:0:14121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349880.197153:0:14121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783349880.197174:0:14121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9320f7b31800 from lustre-MDT0000 10000000:01000000:2.0:1783349880.197200:0:14121:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783349880.197203:0:14121:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783349880.197208:0:14121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9320d235b380 10000000:01000000:2.0:1783349880.197213:0:14121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349880.197220:0:14121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9320d235b380 from 1 10000000:01000000:2.0:1783349880.197223:0:14121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783349880.197275:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.197286:0:14121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.197295:0:14121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.197315:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349880.197355:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.197398:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.197683:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789120 00000100:00100000:3.0:1783349880.197691:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789120 00000100:00100000:3.0:1783349880.197746:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349880.197755:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+5:14121:x1869977666789120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349880.197769:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349880.197784:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0031200/0x68b4a22a48477264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847725d expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.197829:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0031200/0x68b4a22a48477264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847725d expref: 6 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.197839:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0031200/0x68b4a22a48477264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847725d expref: 6 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.197847:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0031200, rc 0) 00000100:00100000:3.0:1783349880.197886:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+6:14121:x1869977666789120:12345-0@lo:101:mount.lustre.0 Request processed in 132us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.197892:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349880.197937:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.197953:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.197963:0:14121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.198032:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.200779:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.200956:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783349880.201831:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789248 00000100:00100000:1.0:1783349880.201841:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789248 00000100:00100000:1.0:1783349880.201901:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783349880.201912:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+6:14121:x1869977666789248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349880.202202:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+6:14121:x1869977666789248:12345-0@lo:501:mount.lustre.0 Request processed in 292us (1429us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783349880.202211:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349880.202379:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789248:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783349880.202419:0:14121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783349880.202434:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.202445:0:14121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.202456:0:14121:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9320f7b31800 10000000:01000000:2.0:1783349880.202461:0:14121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783349880.202466:0:14121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9320f7b31800 10000000:01000000:2.0:1783349880.202468:0:14121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783349880.202471:0:14121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9320f7b31800 from 1 10000000:01000000:2.0:1783349880.202474:0:14121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783349880.202504:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.202513:0:14121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.202522:0:14121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.202541:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349880.202583:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.202616:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.203826:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789376 00000100:00100000:3.0:1783349880.203834:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789376 00000100:00100000:3.0:1783349880.203887:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349880.203896:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+6:14121:x1869977666789376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349880.203909:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349880.203925:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030600/0x68b4a22a48477272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847726b expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.203951:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030600/0x68b4a22a48477272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847726b expref: 7 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.203962:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030600/0x68b4a22a48477272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847726b expref: 7 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.203971:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030600, rc 0) 00000100:00100000:3.0:1783349880.204021:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+7:14121:x1869977666789376:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.204027:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349880.204396:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.204411:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477272 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.204420:0:14121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48477272 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.204438:0:14121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783349880.204454:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477272 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.204461:0:14121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97000/0x68b4a22a4847726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477272 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.204468:0:14121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783349880.204473:0:14121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349880.204477:0:14121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9320f7b31800 10000000:01000000:2.0:1783349880.204480:0:14121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783349880.204484:0:14121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783349880.204486:0:14121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783349880.204506:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.204513:0:14121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.204521:0:14121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.204547:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349880.204580:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.204610:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c780 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.204903:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789504 00000100:00100000:3.0:1783349880.204908:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789504 00000100:00100000:3.0:1783349880.204936:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349880.204943:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+7:14121:x1869977666789504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349880.204951:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349880.204959:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030c00/0x68b4a22a48477280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477279 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.204973:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030c00/0x68b4a22a48477280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477279 expref: 8 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.204981:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030c00/0x68b4a22a48477280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477279 expref: 8 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.204993:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030c00, rc 0) 00000100:00100000:3.0:1783349880.205026:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+8:14121:x1869977666789504:12345-0@lo:101:mount.lustre.0 Request processed in 84us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.205032:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349880.205313:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.205324:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477280 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.205332:0:14121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48477280 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.205381:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.205407:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.205432:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783349880.205976:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789632 00000100:00100000:1.0:1783349880.205983:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789632 00000100:00100000:1.0:1783349880.206030:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783349880.206040:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+8:14121:x1869977666789632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349880.206427:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14121:x1869977666789632:12345-0@lo:501:mount.lustre.0 Request processed in 389us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349880.206439:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783349880.206656:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.206693:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783349880.206731:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349880.206858:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789760 00000100:00100000:3.0:1783349880.206863:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789760 00000100:00100000:3.0:1783349880.206892:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349880.206898:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14121:x1869977666789760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783349880.207140:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14121:x1869977666789760:12345-0@lo:503:mount.lustre.0 Request processed in 242us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.207145:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349880.207214:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec53c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.207225:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666789760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783349880.207688:0:14157:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14157:1869977666789888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783349880.207726:0:14157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349880.207898:0:14157:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349880.207935:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666789888 00000100:00100000:1.0:1783349880.207940:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666789888 00000100:00100000:1.0:1783349880.208014:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783349880.208022:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14157:x1869977666789888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349880.208319:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14157:x1869977666789888:12345-0@lo:502:llog_process_th.0 Request processed in 297us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349880.208326:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783349880.208495:0:14157:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14157:1869977666789888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783349880.208517:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349880.208527:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349880.208529:0:14157:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783349880.208535:0:14157:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783349880.208538:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349880.208556:0:14157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9320f7d919c0) 00000020:00000080:0.0:1783349880.208575:0:14157:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783349880.208581:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783349880.208650:0:14157:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783349880.208657:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a4847728e 00000020:00000080:0.0:1783349880.208983:0:14157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783349880.208987:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349880.208991:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349880.208992:0:14157:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783349880.208995:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349880.208998:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349880.208999:0:14157:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783349880.209002:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783349880.209010:0:14157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9320f7d94d40) 00000020:00000080:0.0:1783349880.209019:0:14157:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783349880.209023:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783349880.209025:0:14157:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783349880.209027:0:14157:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783349880.209034:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783349880.209071:0:14157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320f7b31800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783349880.209082:0:14157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9320f7d90000) 00000020:00000080:0.0:1783349880.209089:0:14157:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783349880.209126:0:14157:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783349880.209131:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484772a3 00000020:00000080:0.0:1783349880.209335:0:14157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783349880.209342:0:14157:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783349880.209347:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x68b4a22a484772aa 00080000:01000000:0.0:1783349880.209352:0:14157:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783349880.209356:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a484772b1 00010000:00010000:2.0:1783349880.262616:0:14157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783349880.263166:0:14157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1783349880.263447:0:14157:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783349880.264073:0:14157:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9320c79d99c0) 00000020:00000080:2.0:1783349880.264094:0:14157:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783349880.264153:0:14157:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783349880.264164:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a484772bf 00000020:00000080:2.0:1783349880.264786:0:14157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783349880.271070:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x68b4a22a484772c6 00000020:00000080:2.0:1783349880.271531:0:14157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783349880.271543:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349880.271549:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.271551:0:14157:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783349880.271554:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349880.271561:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.271562:0:14157:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783349880.271566:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783349880.271599:0:14157:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783349880.271612:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349880.271615:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.271617:0:14157:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783349880.271619:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783349880.271621:0:14157:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1783349880.271623:0:14157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783349880.271624:0:14157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783349880.271626:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783349880.271628:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.271629:0:14157:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783349880.271631:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783349880.271635:0:14157:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783349880.271638:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.271640:0:14157:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783349880.271643:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783349880.271649:0:14157:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.136@tcp to nid 0x20000c0a8cc88 (192.168.204.136@tcp) 00000020:01000000:2.0:1783349880.271687:0:14157:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783349880.271691:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783349880.271705:0:14157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9320c79d8000) 00000020:00000080:2.0:1783349880.271719:0:14157:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1783349880.271724:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783349880.271946:0:14157:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783349880.271951:0:14157:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783349880.271959:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a484772d4 00010000:00080000:2.0:1783349880.271990:0:14157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320f70f3000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.136@tcp at head 00010000:00010000:2.0:1783349880.272204:0:14157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1783349880.273164:0:14157:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783349880.273202:0:14157:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783349880.275107:0:14157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349880.275173:0:14157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783349880.275338:0:14157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1783349880.275731:0:14161:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783349880.275736:0:14161:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783349880.276551:0:14157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783349880.276564:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783349880.276594:0:14157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783349880.276613:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484772db 00000100:00080000:2.0:1783349880.276625:0:14157:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349880.276632:0:14157:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9320f70f3000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349880.276672:0:14157:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5904700 x1869977666790016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349880.276754:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666790016:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783349880.276831:0:3290:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977666790016 offset 0 length 520: 4 00000100:00080000:2.0:1783349880.276961:0:14157:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783349880.277007:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349880.277011:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.277013:0:14157:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783349880.277015:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783349880.277018:0:14157:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1783349880.277019:0:14157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783349880.277021:0:14157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783349880.277022:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783349880.277024:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.277025:0:14157:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783349880.277028:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783349880.277032:0:14157:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783349880.277035:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.277041:0:14157:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783349880.277045:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783349880.277049:0:14157:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.136@tcp to nid 0x20000c0a8cc88 (192.168.204.136@tcp) 00000020:01000000:2.0:1783349880.277067:0:14157:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783349880.277070:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783349880.277081:0:14157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9320c79db380) 00000020:00000080:2.0:1783349880.277093:0:14157:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783349880.277097:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783349880.277156:0:14157:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783349880.277162:0:14157:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783349880.277168:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x68b4a22a484772e9 00010000:00080000:2.0:1783349880.277194:0:14157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320c8673000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.136@tcp at head 00010000:00010000:2.0:1783349880.277662:0:14157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783349880.277974:0:14157:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783349880.277994:0:14157:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783349880.278596:0:14157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349880.278663:0:14157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783349880.278875:0:14157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1783349880.279614:0:14163:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783349880.279619:0:14163:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783349880.280346:0:14157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783349880.280357:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783349880.280384:0:14157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783349880.280400:0:14157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484772f0 00000100:00080000:2.0:1783349880.280409:0:14157:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349880.280415:0:14157:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9320c8673000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349880.280446:0:14157:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5904e00 x1869977666790144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349880.280503:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666790144:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783349880.280563:0:3290:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869977666790144 offset 0 length 520: 4 00000100:00080000:2.0:1783349880.280611:0:14157:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783349880.280658:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349880.280662:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.280664:0:14157:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783349880.280671:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349880.280675:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.280677:0:14157:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783349880.280679:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783349880.280681:0:14157:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783349880.280683:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349880.280686:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.280687:0:14157:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783349880.280689:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783349880.280691:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.280693:0:14157:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783349880.280696:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783349880.280723:0:14157:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14157:1869977666790272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349880.280851:0:14157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.280879:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666790272 00000100:00100000:2.0:1783349880.280886:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666790272 00000100:00100000:2.0:1783349880.280919:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783349880.280926:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14157:x1869977666790272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349880.281136:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14157:x1869977666790272:12345-0@lo:502:llog_process_th.0 Request processed in 209us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349880.281144:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783349880.281182:0:14157:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.281204:0:14157:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14157:1869977666790272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783349880.281369:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783349880.281375:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783349880.281376:0:14157:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783349880.281380:0:14157:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783349880.281420:0:14121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783349880.281438:0:14121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783349880.281490:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477280 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.281507:0:14121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac96400/0x68b4a22a48477279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477280 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.281516:0:14121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320f7b31800 from 1 10000000:01000000:2.0:1783349880.281519:0:14121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783349880.281545:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.281553:0:14121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.281562:0:14121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.281576:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349880.281602:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.281617:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.281677:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666790400 00000100:00100000:3.0:1783349880.281683:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666790400 00000100:00100000:3.0:1783349880.281718:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349880.281725:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+9:14121:x1869977666790400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349880.281735:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349880.281748:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484772f7 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.281768:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 10 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.281779:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 10 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.281788:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030e00, rc 0) 00000100:00100000:3.0:1783349880.281857:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+10:14121:x1869977666790400:12345-0@lo:101:mount.lustre.0 Request processed in 131us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.281869:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783349880.281905:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.281918:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.281926:0:14121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.282525:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790528:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783349880.282563:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.282596:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.282661:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666790528 00000100:00100000:3.0:1783349880.282667:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666790528 00000100:00100000:3.0:1783349880.282700:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783349880.282707:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+10:14121:x1869977666790528:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783349880.282722:0:14134:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783349880.282728:0:14134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783349880.282850:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790528:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783349880.282896:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+10:14121:x1869977666790528:12345-0@lo:256:mount.lustre.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.282904:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:2.0:1783349880.283504:0:14121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783349880.283640:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.283651:0:14121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.283658:0:14121:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f7b31800 from 1 10000000:01000000:2.0:1783349880.283660:0:14121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349880.283686:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.283693:0:14121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.283701:0:14121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.283717:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349880.283767:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.283817:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.283845:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666790656 00000100:00100000:3.0:1783349880.283851:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666790656 00000100:00100000:3.0:1783349880.283878:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783349880.283885:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+10:14121:x1869977666790656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349880.283896:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349880.283907:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477305 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.283925:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477305 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.283935:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477305 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.283944:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030a00, rc 0) 00000100:00100000:3.0:1783349880.283983:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666790656:12345-0@lo:101:mount.lustre.0 Request processed in 98us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.283989:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783349880.284001:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.284014:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.284022:0:14121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.284074:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.284098:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.284122:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.284284:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666790784 00000100:00100000:3.0:1783349880.284288:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666790784 00000100:00100000:3.0:1783349880.284315:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783349880.284323:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666790784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783349880.284863:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666790784:12345-0@lo:501:mount.lustre.0 Request processed in 540us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.284870:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349880.284925:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.284957:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790912:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783349880.284996:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.285049:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.285076:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666790912 00000100:00100000:3.0:1783349880.285081:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666790912 00000100:00100000:3.0:1783349880.285136:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783349880.285144:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666790912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783349880.285304:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666790912:12345-0@lo:503:mount.lustre.0 Request processed in 160us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.285311:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783349880.285378:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666790912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783349880.286754:0:14165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14165:1869977666791040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349880.286834:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349880.286863:0:14165:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256480 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.286928:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791040 00000100:00100000:2.0:1783349880.286935:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791040 00000100:00100000:2.0:1783349880.286976:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783349880.286989:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14165:x1869977666791040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349880.287217:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14165:x1869977666791040:12345-0@lo:502:llog_process_th.0 Request processed in 232us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349880.287236:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783349880.287296:0:14165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14165:1869977666791040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349880.287326:0:14165:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349880.287335:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349880.287338:0:14165:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783349880.287345:0:14165:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320f7b31800 00000020:00000080:3.0:1783349880.287348:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783349880.287358:0:14165:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349880.287361:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349880.287362:0:14165:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783349880.287365:0:14165:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349880.287367:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349880.287374:0:14165:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783349880.287379:0:14165:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9320f7b31800 00000020:00000080:3.0:1783349880.287381:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783349880.287442:0:14165:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349880.287446:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349880.287447:0:14165:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783349880.287450:0:14165:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349880.287453:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349880.287454:0:14165:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783349880.287457:0:14165:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9320f7b31800 00000020:00000080:3.0:1783349880.287458:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783349880.287491:0:14165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14165:1869977666791168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783349880.287526:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349880.287544:0:14165:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0a38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349880.287611:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791168 00000100:00100000:1.0:1783349880.287616:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791168 00000100:00100000:1.0:1783349880.287656:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783349880.287664:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14165:x1869977666791168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349880.287829:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14165:x1869977666791168:12345-0@lo:502:llog_process_th.0 Request processed in 163us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349880.287837:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783349880.288085:0:14165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14165:1869977666791168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783349880.288104:0:14165:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349880.288108:0:14165:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349880.288109:0:14165:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783349880.288113:0:14165:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783349880.291694:0:14121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783349880.291739:0:14121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349880.291847:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.291860:0:14121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.291909:0:14121:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783349880.291912:0:14121:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9320f7b31800 10000000:01000000:2.0:1783349880.291915:0:14121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9320f7b31800 10000000:01000000:2.0:1783349880.291924:0:14121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349880.291930:0:14121:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9320f7b31800 from 1 10000000:01000000:2.0:1783349880.291933:0:14121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349880.291968:0:14121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.291977:0:14121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.291986:0:14121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.292010:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666791296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349880.292077:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.292112:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.292138:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791296 00000100:00100000:2.0:1783349880.292144:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791296 00000100:00100000:2.0:1783349880.292183:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783349880.292191:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666791296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.292204:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349880.292218:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac96c00/0x68b4a22a4847731a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477313 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.292240:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96c00/0x68b4a22a4847731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477313 expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.292249:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac96c00/0x68b4a22a4847731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477313 expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.292269:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96c00, rc 0) 00000100:00100000:2.0:1783349880.292312:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14121:x1869977666791296:12345-0@lo:101:mount.lustre.0 Request processed in 121us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349880.292319:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783349880.292369:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666791296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349880.292385:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847731a expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.292393:0:14121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847731a expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349880.292436:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666791424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.292459:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.294816:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21faf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349880.296591:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791424 00000100:00100000:1.0:1783349880.296604:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791424 00000100:00100000:1.0:1783349880.296671:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783349880.296681:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14121:x1869977666791424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349880.297123:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14121:x1869977666791424:12345-0@lo:501:mount.lustre.0 Request processed in 443us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349880.297132:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349880.299316:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666791424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349880.299404:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666791552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783349880.299466:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.299498:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791552 00000100:00100000:2.0:1783349880.299504:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791552 00000100:00100000:2.0:1783349880.299552:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783349880.299559:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14121:x1869977666791552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783349880.299718:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14121:x1869977666791552:12345-0@lo:503:mount.lustre.0 Request processed in 158us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349880.299726:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783349880.299773:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.299806:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666791552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783349880.300069:0:14170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14170:1869977666791680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349880.300104:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349880.300127:0:14170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320de7d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.300292:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791680 00000100:00100000:2.0:1783349880.300296:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791680 00000100:00100000:2.0:1783349880.300327:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783349880.300334:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14170:x1869977666791680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349880.300493:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14170:x1869977666791680:12345-0@lo:502:llog_process_th.0 Request processed in 159us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349880.300500:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349880.300884:0:14170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14170:1869977666791680:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783349880.300942:0:14170:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783349880.300957:0:14170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9320d2358000) 00000020:00000080:1.0:1783349880.300981:0:14170:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1783349880.305915:0:14170:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9320f7b31800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783349880.305927:0:14170:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9320f7b31800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783349880.305930:0:14170:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9320f7b31800 4 00010000:00080000:1.0:1783349880.305971:0:14170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320fa58a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.136@tcp at head 00010000:00010000:1.0:1783349880.310987:0:14170:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1783349880.311092:0:14170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783349880.311128:0:14170:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783349880.311146:0:14170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x68b4a22a48477328 00000100:00080000:1.0:1783349880.311158:0:14170:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783349880.311164:0:14170:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9320fa58a800 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:1.0:1783349880.311198:0:14170:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320de7a9500 x1869977666791808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783349880.311852:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666791808:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783349880.311925:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349880.311991:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791808 00000100:00100000:1.0:1783349880.311999:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791808 00000100:00100000:1.0:1783349880.312038:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349880.312045:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666791808:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783349880.312098:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666791808:12345-0@lo:38:llog_process_th.0 Request processed in 52us (172us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783349880.312105:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349880.312141:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783349880.312149:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320fa58a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783349880.312163:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783349880.312167:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666791808:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783349880.312186:0:14170:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783349880.314012:0:14170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14170:1869977666791936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783349880.314078:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.314110:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666791936 00000100:00100000:1.0:1783349880.314117:0:14170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320de7d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1783349880.314118:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666791936 00000100:00100000:2.0:1783349880.314161:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783349880.314169:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14170:x1869977666791936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783349880.315134:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14170:x1869977666791936:12345-0@lo:502:llog_process_th.0 Request processed in 964us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349880.315143:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783349880.315346:0:14170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14170:1869977666791936:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783349880.315373:0:14170:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783349880.315430:0:14121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783349880.315449:0:14121:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349880.315478:0:14121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847731a expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.315489:0:14121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac96a00/0x68b4a22a48477313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847731a expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783349880.315533:0:14121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783349880.315536:0:14121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349880.315537:0:14121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349880.315538:0:14121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349880.315539:0:14121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349880.315541:0:14121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349880.315542:0:14121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349880.315548:0:14121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349880.315549:0:14121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349880.315550:0:14121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349880.315554:0:14121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783349880.315556:0:14121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349880.315557:0:14121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349880.315558:0:14121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349880.315559:0:14121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349880.315560:0:14121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349880.315561:0:14121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349880.315562:0:14121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349880.315563:0:14121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349880.315564:0:14121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349880.315565:0:14121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349880.315579:0:14121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783349880.315591:0:14121:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666792064:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783349880.315622:0:14121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349880.315652:0:14121:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349880.315844:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792064 00000100:00100000:1.0:1783349880.315851:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792064 00000100:00100000:1.0:1783349880.315881:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349880.315889:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14121:x1869977666792064:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783349880.315917:0:14132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783349880.315929:0:14132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783349880.352413:0:14132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783349880.352433:0:14132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783349880.352476:0:14155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783349880.352493:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783349880.352561:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.352582:0:14155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.352592:0:14155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.352631:0:14155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.352645:0:14155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 12 pid: 14132 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349880.352659:0:14155:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14155:1869977666792192:0@lo:104: 00000100:00100000:0.0:1783349880.352730:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349880.352779:0:14155:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ca06a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783349880.352937:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792192 00000100:00100000:3.0:1783349880.352945:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792192 00000100:00100000:3.0:1783349880.352990:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349880.352998:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14155:x1869977666792192:12345-0@lo:104: 00010000:00010000:3.0:1783349880.353010:0:14122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.353067:0:14122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349880.353073:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14155:x1869977666792192:12345-0@lo:104: Request processed in 77us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.353081:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349880.353128:0:14155:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14155:1869977666792192:0@lo:104: 00010000:00010000:3.0:1783349880.353145:0:14155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.353302:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349880.353309:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.353316:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:2.0:1783349880.353320:0:14128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.353328:0:14128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783349880.353335:0:14128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349880.353351:0:14128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783349880.353389:0:14128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.353397:0:14128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783349880.353422:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.353429:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a484772f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484772fe expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349880.353449:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349880.353450:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349880.353452:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349880.353492:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3291:1869977666792320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349880.353581:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349880.353689:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792320 00000100:00100000:0.0:1783349880.353694:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792320 00010000:00010000:0.0:1783349880.353712:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 13 pid: 14132 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349880.353740:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349880.353747:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+13:3291:x1869977666792320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349880.353758:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349880.353763:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 13 pid: 14132 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353773:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 13 pid: 14132 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353821:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030e00/0x68b4a22a484772fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484772f7 expref: 13 pid: 14132 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353835:0:14124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353842:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783349880.353856:0:14124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001364548s 00010000:00010000:0.0:1783349880.353860:0:14124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353868:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353875:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353881:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353886:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349880.353890:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353896:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353917:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349880.353933:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349880.353971:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:3291:x1869977666792320:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349880.353978:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349880.354024:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3291:1869977666792320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349880.354073:0:14155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.354081:0:14155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349880.354087:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fb4a6200/0x68b4a22a4847732f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349880.365628:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14121:x1869977666792064:12345-0@lo:253:mount.lustre.0 Request processed in 49730us (49994us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349880.365640:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783349880.365746:0:14121:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14121:1869977666792064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783349880.365759:0:14121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783349880.365761:0:14121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349880.365762:0:14121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783349880.365763:0:14121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349880.365764:0:14121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349880.365765:0:14121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349880.365766:0:14121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349880.365767:0:14121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783349880.365768:0:14121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783349880.365769:0:14121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349880.365770:0:14121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783349880.365783:0:14121:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783349880.370787:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349880.371085:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349880.371382:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349880.371661:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349880.372200:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349880.372493:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349880.373292:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349880.373438:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349880.373681:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349880.374035:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783349880.374308:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783349880.374459:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1783349880.412646:0:14121:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783349880.413119:0:14121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783349880.413459:0:14178:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1783349880.413518:0:14178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349880.415571:0:14178:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783349880.415632:0:14178:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783349880.415636:0:14178:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:1.0:1783349880.416068:0:14177:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1783349880.416073:0:14177:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783349880.416201:0:14121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783349880.416333:0:14121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783349880.416810:0:14121:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783349880.416818:0:14121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783349880.416917:0:14121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349880.418083:0:14121:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783349880.418591:0:14121:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783349880.418615:0:14121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783349880.419056:0:14121:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1783349880.419735:0:14121:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1783349880.423412:0:14121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783349880.447077:0:14121:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783349880.447115:0:14121:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacb5c1a5f988 00100000:10000000:0.0:1783349880.447123:0:14121:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783349880.447973:0:14121:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783349880.447996:0:14121:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783349880.448012:0:14121:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1783349880.448029:0:14121:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783349881.130368:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349881.194929:0:14136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349881.194937:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320f7b31800 from 6 10000000:01000000:0.0:1783349881.194942:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349881.194986:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349881.194999:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349881.195010:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349881.195036:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666792448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349881.195114:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349881.195161:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349881.195268:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792448 00000100:00100000:2.0:1783349881.195276:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792448 00000100:00100000:2.0:1783349881.195323:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783349881.195331:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14136:x1869977666792448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349881.195345:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349881.195357:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477336 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349881.195379:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477336 expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349881.195391:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477336 expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349881.195400:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:2.0:1783349881.195439:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666792448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349881.195446:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783349881.195631:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666792448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349881.195645:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349881.195652:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349881.195699:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666792576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783349881.195727:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349881.195750:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783349881.197847:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792576 00000100:00100000:2.0:1783349881.197859:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792576 00000100:00100000:2.0:1783349881.197904:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783349881.197912:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666792576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783349881.197933:0:14132:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783349881.197947:0:14132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783349881.197950:0:14132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783349881.198062:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666792576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349881.198070:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783349881.198582:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666792576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783349881.198630:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783349881.198639:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349881.198650:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349881.322009:0:14173:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349881.322018:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349881.322504:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783349881.322513:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783349882.156935:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349882.346017:0:14173:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349882.346027:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349882.346064:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783349882.346073:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1783349882.858588:0:14422:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783349883.178137:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349884.203084:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783349884.635774:0:14572:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc86a3a00 20000000:00000080:3.0:1783349884.635814:0:14572:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9320c4450800 uarg=0000000000000000 20000000:01000000:3.0:1783349884.635849:0:14572:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783349884.635856:0:14572:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783349884.635861:0:14572:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783349884.637488:0:14573:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1783349884.642513:0:14572:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783349884.648522:0:14572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783349884.648556:0:14572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.648575:0:14572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477305 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.648584:0:14572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.648645:0:14572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48477305 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.648660:0:14572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48477305 expref: 11 pid: 14132 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349884.648742:0:14572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14572:1869977666792704:0@lo:104: 00000100:00100000:2.0:1783349884.648928:0:14572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349884.649022:0:14572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c4bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349884.649074:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792704 00000100:00100000:1.0:1783349884.649087:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792704 00000100:00100000:1.0:1783349884.649256:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349884.649267:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14572:x1869977666792704:12345-0@lo:104: 00010000:00010000:1.0:1783349884.649279:0:14122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349884.649379:0:14122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783349884.649386:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14572:x1869977666792704:12345-0@lo:104: Request processed in 121us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349884.649393:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783349884.649414:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349884.649419:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349884.649426:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349884.649430:0:14127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349884.649437:0:14127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349884.649444:0:14127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349884.649450:0:14127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783349884.649482:0:14127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349884.649488:0:14127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349884.649509:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349884.649521:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fac96600/0x68b4a22a48477305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847730c expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349884.649539:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349884.649540:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349884.649542:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349884.649555:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3292:1869977666792832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783349884.649586:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349884.649657:0:14572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14572:1869977666792704:0@lo:104: 00010000:00010000:2.0:1783349884.649783:0:14572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349884.650040:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792832 00000100:00100000:2.0:1783349884.650045:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792832 00010000:00010000:2.0:1783349884.650065:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48477305 expref: 12 pid: 14132 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349884.650132:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783349884.650141:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:3292:x1869977666792832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349884.650153:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349884.650159:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48477305 expref: 12 pid: 14132 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650180:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48477305 expref: 12 pid: 14132 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650194:0:14126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c0030a00/0x68b4a22a4847730c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48477305 expref: 12 pid: 14132 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650214:0:14126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650222:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650237:0:14126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650244:0:14126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650251:0:14126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650257:0:14126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650263:0:14126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349884.650268:0:14126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650276:0:14126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650291:0:14126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349884.650301:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349884.650331:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:3292:x1869977666792832:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349884.650343:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783349884.650455:0:14572:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349884.650466:0:14572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349884.650472:0:14572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac96e00/0x68b4a22a48477344 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349884.650569:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3292:1869977666792832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349885.225916:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349885.739234:0:14136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783349885.739243:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f7b31800 from 10 10000000:01000000:0.0:1783349885.739249:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783349885.739300:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349885.739311:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349885.739322:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349885.739362:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666792960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349885.739431:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349885.739495:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349885.739601:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666792960 00000100:00100000:2.0:1783349885.739608:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666792960 00000100:00100000:2.0:1783349885.739661:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783349885.739669:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+11:14136:x1869977666792960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349885.739683:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349885.739697:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847734b expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349885.739721:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847734b expref: 12 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349885.739730:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847734b expref: 12 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349885.739739:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97200, rc 0) 00000100:00100000:2.0:1783349885.739785:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666792960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349885.739819:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783349885.740002:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666792960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783349885.740016:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349885.740025:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349885.740074:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666793088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349885.740100:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349885.740139:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349885.740229:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793088 00000100:00100000:2.0:1783349885.740235:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793088 00000100:00100000:2.0:1783349885.740267:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783349885.740274:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666793088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349885.740533:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666793088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349885.740541:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783349885.740785:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666793088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349885.740838:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666793216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349885.740873:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349885.740901:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff931fc46489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349885.740990:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793216 00000100:00100000:2.0:1783349885.741000:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793216 00000100:00100000:2.0:1783349885.741033:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783349885.741040:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666793216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349885.741205:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14136:x1869977666793216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349885.741212:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349885.741273:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666793216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783349885.742728:0:14641:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783349885.742911:0:14136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783349885.742941:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349885.742952:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349885.742961:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783349885.802173:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783349885.802185:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783349885.802189:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783349885.802192:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783349885.802214:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783349885.802219:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783349885.802223:0:8:0:(import.c:65:import_set_state_nolock()) ffff9320fa58a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783349885.802236:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9320fa58a800 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:0.0:1783349885.802273:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9320e40a8a80 x1869977666793344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349885.802457:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666793344:0@lo:38:kworker.0 00000100:00100000:2.0:1783349885.802536:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349885.802674:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793344 00000100:00100000:1.0:1783349885.802692:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793344 00000100:00100000:1.0:1783349885.802733:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349885.802742:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1869977666793344:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783349885.803614:0:14141:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1783349885.803651:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x68b4a22a48477359 00000004:00100000:1.0:1783349885.803667:0:14141:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783349885.804010:0:14141:0:(import.c:65:import_set_state_nolock()) ffff9320fd65f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349885.804086:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1869977666793344:12345-0@lo:38:kworker.0 Request processed in 1343us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349885.804096:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783349885.804126:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9320e40a8a80 x1869977666793344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783349885.804142:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783349885.804162:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783349885.804168:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783349885.804171:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320fa58a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783349885.804178:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1869977666793344:0@lo:38:kworker.0 00010000:00010000:3.0:1783349886.250090:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349887.273931:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783349887.480321:0:14773:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783349887.480337:0:14773:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783349887.480487:0:14773:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff931fc7b8e000 00000020:01000004:2.0:1783349887.480502:0:14773:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783349887.480513:0:14773:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783349887.480541:0:14773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9320fb12cd40) 00000020:00000080:2.0:1783349887.480559:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783349887.495259:0:14773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783349887.495519:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783349887.496286:0:14773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783349887.496530:0:14773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783349887.497472:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783349887.498033:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1783349887.498141:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1783349887.498245:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1783349887.498736:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:2.0:1783349887.499008:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:2.0:1783349887.499351:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 776: rc = 0 00100000:10000000:2.0:1783349887.499622:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 776: rc = 0 00100000:10000000:2.0:1783349887.501147:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 776: rc = 0 00100000:10000000:2.0:1783349887.501411:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 776: rc = 0 00000020:00000080:2.0:1783349887.502104:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783349887.502127:0:14773:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783349887.502138:0:14773:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x68b4a22a48477367 00000020:01000004:2.0:1783349887.502145:0:14773:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783349887.502170:0:14773:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.136@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783349887.502174:0:14773:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783349887.502181:0:14773:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783349887.502187:0:14773:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783349887.502202:0:14773:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9320fb1299c0) 00000020:00000080:2.0:1783349887.502213:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1783349887.503384:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349887.503564:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349887.503577:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783349887.507579:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783349887.507588:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783349887.507912:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783349887.507918:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783349887.509226:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349887.509421:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783349887.509427:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783349887.509937:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783349887.509944:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783349887.525515:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349887.525753:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783349887.525760:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783349887.528201:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783349887.528213:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783349887.529232:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783349887.529240:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783349887.531170:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349887.531338:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783349887.531342:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783349887.531997:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783349887.532005:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783349887.568070:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783349887.568238:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783349887.568246:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783349887.569262:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783349887.569271:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783349887.569657:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783349887.569680:0:14773:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1783349887.569686:0:14773:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783349887.578545:0:14773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783349887.578588:0:14773:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.136@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783349887.578593:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783349887.578595:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349887.578596:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349887.578597:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349887.578599:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349887.578600:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349887.578601:0:14773:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349887.578603:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349887.578605:0:14773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783349887.578608:0:14773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783349887.578611:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349887.578616:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349887.578617:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349887.578618:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349887.578619:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349887.578620:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349887.578621:0:14773:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349887.578621:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349887.578622:0:14773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783349887.578655:0:14773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783349887.578675:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783349887.578744:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.579006:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349887.579093:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793472 00000100:00100000:3.0:1783349887.579101:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793472 00000100:00100000:3.0:1783349887.579195:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783349887.579204:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14773:x1869977666793472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783349887.579234:0:14134:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783349887.579244:0:14134:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783349887.579249:0:14134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783349887.587840:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14773:x1869977666793472:12345-0@lo:253:mount.lustre.0 Request processed in 8626us (9085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.587858:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783349887.587988:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783349887.588003:0:14773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783349887.588007:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349887.588008:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349887.588010:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349887.588011:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349887.588013:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349887.588014:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349887.588016:0:14773:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349887.588018:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349887.588019:0:14773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783349887.588047:0:14773:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931fc7b8e000 from lustre-OST0000 10000000:01000000:2.0:1783349887.588073:0:14773:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783349887.588076:0:14773:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783349887.588081:0:14773:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9320d235b380 local copy 00010000:00010000:2.0:1783349887.588092:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349887.588627:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349887.588665:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.588748:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.589111:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793600 00000100:00100000:0.0:1783349887.589134:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793600 00000100:00100000:0.0:1783349887.589172:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783349887.589181:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14773:x1869977666793600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783349887.589745:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14773:x1869977666793600:12345-0@lo:501:mount.lustre.0 Request processed in 563us (1077us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349887.589755:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783349887.589897:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793600:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783349887.589917:0:14773:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783349887.590184:0:14773:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783349887.590195:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590205:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349887.590231:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931fc7b8e000 10000000:01000000:3.0:1783349887.590236:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783349887.590240:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9320d235b380 10000000:01000000:3.0:1783349887.590243:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783349887.590247:0:14773:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9320d235b380 from 1 10000000:01000000:3.0:1783349887.590249:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783349887.590279:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590289:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590299:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349887.590316:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783349887.590358:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.590389:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349887.590407:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793728 00000100:00100000:2.0:1783349887.590581:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793728 00000100:00100000:2.0:1783349887.590621:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783349887.590629:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+12:14773:x1869977666793728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349887.590640:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349887.590654:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac96200/0x68b4a22a4847737c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477375 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.590675:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96200/0x68b4a22a4847737c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477375 expref: 13 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.590686:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac96200/0x68b4a22a4847737c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477375 expref: 13 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.590694:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96200, rc 0) 00000100:00100000:2.0:1783349887.590734:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+13:14773:x1869977666793728:12345-0@lo:101:mount.lustre.0 Request processed in 106us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.590741:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783349887.590825:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349887.590838:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847737c expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590847:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847737c expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349887.590863:0:14773:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783349887.590912:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847737c expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590920:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0030e00/0x68b4a22a48477375 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847737c expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349887.590926:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783349887.590930:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349887.590935:0:14773:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783349887.590937:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783349887.590950:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590957:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.590966:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349887.590977:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783349887.591007:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.591038:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.591062:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793856 00000100:00100000:0.0:1783349887.591067:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793856 00000100:00100000:0.0:1783349887.591095:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783349887.591103:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+13:14773:x1869977666793856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783349887.591110:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349887.591131:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fb4a7600/0x68b4a22a4847738a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477383 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349887.591147:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a7600/0x68b4a22a4847738a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477383 expref: 14 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349887.591156:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fb4a7600/0x68b4a22a4847738a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477383 expref: 14 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349887.592549:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7600, rc 0) 00000100:00100000:0.0:1783349887.592685:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666793856:12345-0@lo:101:mount.lustre.0 Request processed in 1580us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.592693:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783349887.594078:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783349887.594102:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847738a expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.594114:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847738a expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783349887.595332:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783349887.596646:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783349887.597063:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783349887.597109:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783349887.597217:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783349887.597280:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783349887.597320:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783349887.597356:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783349887.597519:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783349887.597529:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783349887.597611:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783349887.597678:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.597731:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349887.597947:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666793984 00000100:00100000:2.0:1783349887.597956:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666793984 00000100:00100000:2.0:1783349887.598001:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783349887.598011:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666793984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349887.598502:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666793984:12345-0@lo:501:mount.lustre.0 Request processed in 492us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.598511:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783349887.598543:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666793984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783349887.598581:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783349887.598621:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.598695:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.598731:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794112 00000100:00100000:0.0:1783349887.598736:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794112 00000100:00100000:0.0:1783349887.598764:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783349887.598771:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783349887.599353:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794112:12345-0@lo:503:mount.lustre.0 Request processed in 581us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.599361:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783349887.599519:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783349887.600259:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783349887.600327:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783349887.600378:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.600615:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681600 going to sleep for 11 seconds 00000100:00100000:2.0:1783349887.600656:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794240 00000100:00100000:2.0:1783349887.600663:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794240 00000100:00100000:2.0:1783349887.600763:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783349887.600772:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783349887.601062:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794240:12345-0@lo:502:mount.lustre.0 Request processed in 290us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349887.601070:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783349887.601189:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783349887.601480:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783349887.601542:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783349887.601579:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783349887.601627:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783349887.601664:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783349887.601699:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783349887.601755:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783349887.601785:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783349887.601841:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783349887.601891:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783349887.601927:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783349887.601977:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783349887.602011:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783349887.602057:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.602094:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681600 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.602289:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794368 00000100:00100000:0.0:1783349887.602297:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794368 00000100:00100000:0.0:1783349887.602344:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783349887.602353:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349887.603397:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794368:12345-0@lo:502:mount.lustre.0 Request processed in 1043us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349887.603406:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783349887.603933:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783349887.605216:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783349887.605242:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1783349887.606469:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783349887.606478:0:14787:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1783349887.606641:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.606645:0:14787:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783349887.606651:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783349887.606666:0:14787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9320d23599c0) 00000020:00000080:1.0:1783349887.606688:0:14787:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783349887.606694:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783349887.606751:0:14787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931fc7b8e000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783349887.606759:0:14787:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783349887.606765:0:14787:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x68b4a22a48477398 00010000:00010000:1.0:1783349887.612976:0:14787:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1783349887.613569:0:14787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1783349887.615326:0:14787:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1783349887.616964:0:14787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783349887.616976:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349887.616982:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.616984:0:14787:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783349887.616988:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783349887.616991:0:14787:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783349887.616992:0:14787:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783349887.616994:0:14787:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783349887.616995:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783349887.616997:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.616998:0:14787:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783349887.617001:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349887.617003:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.617005:0:14787:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783349887.617007:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783349887.617009:0:14787:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783349887.617011:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349887.617013:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.617015:0:14787:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783349887.617017:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783349887.617019:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.617021:0:14787:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783349887.617030:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783349887.617096:0:14787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783349887.617100:0:14787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349887.617102:0:14787:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783349887.617105:0:14787:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783349887.617544:0:14773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783349887.617573:0:14773:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783349887.617634:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847738a expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.617647:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0031c00/0x68b4a22a48477383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847738a expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349887.617656:0:14773:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff931fc7b8e000 from 1 10000000:01000000:2.0:1783349887.617659:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783349887.617692:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.617700:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.617711:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349887.617734:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349887.617826:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.617860:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349887.617932:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794496 00000100:00100000:1.0:1783349887.617939:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794496 00000100:00100000:1.0:1783349887.617984:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783349887.617993:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+14:14773:x1869977666794496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783349887.618006:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349887.618019:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847739f expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349887.618051:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847739f expref: 15 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349887.618062:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847739f expref: 15 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349887.618071:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb800, rc 0) 00000100:00100000:1.0:1783349887.618110:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794496:12345-0@lo:101:mount.lustre.0 Request processed in 118us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349887.618128:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783349887.618216:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349887.618231:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.618251:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349887.618722:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783349887.619176:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349887.619435:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783349887.619478:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783349887.619553:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783349887.619562:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783349887.619625:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349887.619676:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.619712:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349887.619971:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794624 00000100:00100000:1.0:1783349887.619979:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794624 00000100:00100000:1.0:1783349887.620014:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783349887.620022:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349887.620279:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794624:12345-0@lo:501:mount.lustre.0 Request processed in 256us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349887.620298:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783349887.623658:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349887.623714:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783349887.623771:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.623823:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349887.623825:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794752 00000100:00100000:3.0:1783349887.623832:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794752 00000100:00100000:3.0:1783349887.623881:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783349887.623890:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783349887.624251:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794752:12345-0@lo:503:mount.lustre.0 Request processed in 361us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.624259:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783349887.624457:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794752:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783349887.625666:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783349887.625755:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783349887.625885:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.626132:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349887.626135:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666794880 00000100:00100000:1.0:1783349887.626142:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666794880 00000100:00100000:1.0:1783349887.626196:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783349887.626205:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349887.626390:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666794880:12345-0@lo:502:mount.lustre.0 Request processed in 186us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349887.626398:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783349887.626744:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666794880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783349887.627051:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783349887.627113:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783349887.627180:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783349887.627230:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783349887.627260:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783349887.627306:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783349887.627338:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783349887.627366:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783349887.627395:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783349887.627441:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.627473:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349887.629014:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795008 00000100:00100000:3.0:1783349887.629027:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795008 00000100:00100000:3.0:1783349887.629098:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783349887.629107:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666795008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783349887.629458:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666795008:12345-0@lo:502:mount.lustre.0 Request processed in 351us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.629466:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783349887.629493:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783349887.629632:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783349887.629646:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783349887.631730:0:14791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349887.631744:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349887.631747:0:14791:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783349887.631755:0:14791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff931fc7b8e000 00000020:00000080:0.0:1783349887.631757:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349887.631765:0:14791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349887.631767:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349887.631768:0:14791:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783349887.631770:0:14791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349887.631773:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349887.631774:0:14791:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783349887.631777:0:14791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff931fc7b8e000 00000020:00000080:0.0:1783349887.631896:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349887.631994:0:14791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349887.631998:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349887.632000:0:14791:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783349887.632003:0:14791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349887.632006:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349887.632007:0:14791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349887.632010:0:14791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931fc7b8e000 00000020:00000080:0.0:1783349887.632012:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349887.632389:0:14791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349887.632393:0:14791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349887.632395:0:14791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783349887.632398:0:14791:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1783349887.632835:0:14773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783349887.632862:0:14773:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783349887.632880:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.632892:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783349887.632934:0:14773:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783349887.632937:0:14773:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931fc7b8e000 10000000:01000000:2.0:1783349887.632941:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931fc7b8e000 10000000:01000000:2.0:1783349887.632944:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783349887.632950:0:14773:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff931fc7b8e000 from 1 10000000:01000000:2.0:1783349887.632953:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783349887.632989:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.632997:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.633020:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349887.633127:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783349887.633196:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.633236:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349887.639598:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795136 00000100:00100000:1.0:1783349887.639613:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795136 00000100:00100000:1.0:1783349887.639669:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783349887.639680:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666795136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783349887.639697:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349887.639714:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacaa00/0x68b4a22a484773b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484773ad expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349887.639745:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacaa00/0x68b4a22a484773b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484773ad expref: 16 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349887.639757:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacaa00/0x68b4a22a484773b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484773ad expref: 16 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349887.639765:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacaa00, rc 0) 00000100:00100000:1.0:1783349887.640072:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795136:12345-0@lo:101:mount.lustre.0 Request processed in 393us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349887.640079:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783349887.640162:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783349887.640182:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773b4 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.640190:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484773b4 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783349887.640770:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783349887.641355:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783349887.641744:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783349887.641788:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783349887.641882:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783349887.641927:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783349887.641962:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783349887.642011:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783349887.642556:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783349887.642599:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783349887.642646:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783349887.642678:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783349887.642707:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783349887.642746:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783349887.642776:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783349887.642837:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783349887.642908:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783349887.642941:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783349887.642983:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783349887.643026:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783349887.643197:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783349887.643233:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783349887.643282:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783349887.643316:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783349887.643349:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783349887.643408:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783349887.643446:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783349887.643478:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783349887.643525:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783349887.643560:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783349887.643642:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783349887.643650:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1783349887.643750:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349887.643838:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.643887:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795264 00000100:00100000:2.0:1783349887.643891:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.643897:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795264 00000100:00100000:0.0:1783349887.643950:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783349887.643961:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783349887.644297:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795264:12345-0@lo:501:mount.lustre.0 Request processed in 338us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.644305:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783349887.644335:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783349887.644371:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783349887.644405:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.644544:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.644840:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795392 00000100:00100000:0.0:1783349887.644846:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795392 00000100:00100000:0.0:1783349887.644879:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783349887.644887:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783349887.645133:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795392:12345-0@lo:503:mount.lustre.0 Request processed in 246us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.645140:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783349887.645248:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783349887.645731:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783349887.645810:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783349887.645858:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349887.645890:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795520 00000100:00100000:2.0:1783349887.645896:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.645897:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795520 00000100:00100000:0.0:1783349887.645929:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783349887.645946:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783349887.646671:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795520:12345-0@lo:502:mount.lustre.0 Request processed in 724us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.646680:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783349887.647266:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783349887.647675:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783349887.647728:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783349887.647758:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783349887.647820:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783349887.647859:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783349887.647904:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783349887.647931:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783349887.647960:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783349887.648004:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783349887.648245:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783349887.648413:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783349887.648492:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783349887.648534:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783349887.648576:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783349887.648631:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783349887.648673:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783349887.648728:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783349887.648787:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783349887.648853:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783349887.648887:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783349887.648933:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783349887.648968:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783349887.649002:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783349887.649050:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783349887.649086:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783349887.649198:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783349887.649494:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783349887.649539:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783349887.649573:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783349887.649603:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783349887.649621:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783349887.649648:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783349887.649677:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783349887.649712:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783349887.649734:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783349887.649759:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783349887.649776:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783349887.650874:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783349887.650988:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783349887.651028:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783349887.651081:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783349887.651673:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.651838:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349887.651850:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795648 00000100:00100000:1.0:1783349887.651866:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795648 00000100:00100000:1.0:1783349887.651922:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783349887.651932:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349887.652203:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666795648:12345-0@lo:502:mount.lustre.0 Request processed in 272us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349887.652211:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783349887.652320:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666795648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783349887.653717:0:14773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1783349887.653740:0:14773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783349887.659051:0:14796:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783349887.659067:0:14796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9320fb128000) 00000020:00000080:2.0:1783349887.659084:0:14796:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783349887.659270:0:14796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931fc7b8e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783349887.659275:0:14796:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931fc7b8e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783349887.659278:0:14796:0:(obd_mount.c:701:lustre_put_lsi()) put ffff931fc7b8e000 3 00010000:00080000:2.0:1783349887.659318:0:14796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320c67af000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.136@tcp at head 00010000:00010000:2.0:1783349887.661275:0:14796:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1783349887.661371:0:14796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783349887.661406:0:14796:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783349887.661681:0:14796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x68b4a22a484773c2 00000100:00080000:2.0:1783349887.661692:0:14796:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349887.661697:0:14796:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9320c67af000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349887.661728:0:14796:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5907480 x1869977666795776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349887.661865:0:14796:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783349887.661866:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1869977666795776:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783349887.661886:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783349887.661890:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783349887.661892:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783349887.661894:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783349887.661946:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666795904:0@lo:400:kworker.0 00000100:00100000:3.0:1783349887.661947:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.662030:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795776 00000100:00100000:2.0:1783349887.662043:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.662049:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795776 00000100:00100000:3.0:1783349887.662086:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666795904 00000100:00100000:3.0:1783349887.662090:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666795904 00000100:00100000:2.0:1783349887.662109:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349887.662128:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666795776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783349887.662150:0:14139:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1783349887.662181:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x68b4a22a484773c9 00000004:00100000:2.0:1783349887.662196:0:14139:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783349887.662239:0:14139:0:(import.c:65:import_set_state_nolock()) ffff931fc57f4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349887.662287:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1869977666795776:12345-0@lo:38:llog_process_th.0 Request processed in 159us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.665812:0:14140:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349887.665827:0:14140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783349887.665848:0:14141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783349887.665866:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349887.665879:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666795904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349887.665936:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349887.665986:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666795904:12345-0@lo:400:kworker.0 Request processed in 111us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.665994:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783349887.666133:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931fc5907b80 x1869977666795904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349887.666149:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666795904:0@lo:400:kworker.0 00010000:00080000:3.0:1783349887.667161:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff931fc5907480 x1869977666795776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349887.667175:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783349887.667194:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1783349887.667205:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000040:00080000:2.0:1783349887.667210:0:14796:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:3.0:1783349887.667211:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783349887.667216:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c67af000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783349887.667226:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1869977666795776:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783349887.667278:0:14773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783349887.667307:0:14773:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783349887.667330:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773b4 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.667348:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97600/0x68b4a22a484773ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773b4 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783349887.667399:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783349887.667401:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349887.667402:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349887.667403:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349887.667405:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349887.667406:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349887.667408:0:14773:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349887.667410:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349887.667412:0:14773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349887.667415:0:14773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783349887.667418:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783349887.667419:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349887.667421:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349887.667422:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349887.667424:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349887.667425:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349887.667426:0:14773:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349887.667427:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349887.667429:0:14773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783349887.667449:0:14773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783349887.667467:0:14773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666796032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783349887.667520:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.667690:0:14773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349887.667860:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796032 00000100:00100000:1.0:1783349887.667870:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796032 00000100:00100000:1.0:1783349887.667908:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783349887.667917:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14773:x1869977666796032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783349887.667943:0:14133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783349887.667957:0:14133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783349887.708281:0:14133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783349887.708301:0:14133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783349887.708455:0:14155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783349887.708460:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783349887.708479:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.708506:0:14155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477336 expref: 16 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.708529:0:14155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.708565:0:14155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a48477336 expref: 16 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.708577:0:14155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a48477336 expref: 16 pid: 14134 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349887.708591:0:14155:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14155:1869977666796160:0@lo:104: 00000100:00100000:2.0:1783349887.708650:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349887.708756:0:14155:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c989f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349887.710550:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796160 00000100:00100000:0.0:1783349887.710562:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796160 00000100:00100000:0.0:1783349887.710603:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349887.710611:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14155:x1869977666796160:12345-0@lo:104: 00010000:00010000:0.0:1783349887.710625:0:14123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349887.710746:0:14123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783349887.710753:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5906680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14155:x1869977666796160:12345-0@lo:104: Request processed in 142us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349887.710760:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349887.714772:0:14155:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14155:1869977666796160:0@lo:104: 00010000:00010000:3.0:1783349887.714781:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349887.714807:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.714818:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:3.0:1783349887.714822:0:14127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.714832:0:14127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783349887.714839:0:14127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349887.714845:0:14127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783349887.714897:0:14127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.714904:0:14127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783349887.714925:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.714932:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6e00/0x68b4a22a48477336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a4847733d expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.714962:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349887.714964:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349887.714965:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349887.714980:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666796288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349887.715039:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349887.715124:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796288 00000100:00100000:3.0:1783349887.715131:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796288 00010000:00010000:3.0:1783349887.715157:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48477336 expref: 17 pid: 14134 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349887.715182:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349887.715190:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:3294:x1869977666796288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783349887.715201:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349887.715206:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a48477336 expref: 17 pid: 14134 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715215:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a48477336 expref: 17 pid: 14134 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715229:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac97400/0x68b4a22a4847733d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a48477336 expref: 17 pid: 14134 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715241:0:14124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715248:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783349887.715261:0:14124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006801579s 00010000:00010000:3.0:1783349887.715270:0:14124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715277:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715284:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715291:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715296:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349887.715300:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715307:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715316:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349887.715325:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349887.715359:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:3294:x1869977666796288:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.715367:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349887.715399:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666796288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349887.715406:0:14155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.715415:0:14155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.715421:0:14155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349887.715426:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac96800/0x68b4a22a484773d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349887.726054:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14773:x1869977666796032:12345-0@lo:253:mount.lustre.0 Request processed in 58129us (58525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349887.726069:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783349887.726202:0:14773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14773:1869977666796032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783349887.726220:0:14773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783349887.726224:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783349887.726242:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783349887.726244:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783349887.726245:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783349887.726247:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783349887.726248:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783349887.726250:0:14773:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783349887.726252:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783349887.726253:0:14773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783349887.726268:0:14773:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783349887.731630:0:14773:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349887.731842:0:14773:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349887.732218:0:14773:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349887.732387:0:14773:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783349887.732539:0:14773:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783349887.732751:0:14773:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783349887.733529:0:14773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783349887.787229:0:14773:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783349887.787240:0:14773:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783349887.787272:0:14773:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783349887.787323:0:14773:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783349887.787337:0:14773:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783349887.787363:0:14773:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1783349888.298229:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349889.322098:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783349889.513875:0:14136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783349889.513883:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320f7b31800 from 7 10000000:01000000:1.0:1783349889.513888:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783349889.513935:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349889.513947:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349889.513959:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349889.513985:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666796416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783349889.514058:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349889.514117:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349889.514325:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796416 00000100:00100000:2.0:1783349889.514334:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796416 00000100:00100000:2.0:1783349889.514397:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783349889.514408:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+15:14136:x1869977666796416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349889.514422:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349889.514435:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484773d7 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349889.514457:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 16 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349889.514468:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 16 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349889.514477:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:2.0:1783349889.514518:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14136:x1869977666796416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349889.514533:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783349889.514577:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666796416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349889.514591:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349889.514599:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349889.514646:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666796544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783349889.514679:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349889.514696:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349889.514698:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796544 00000100:00100000:3.0:1783349889.514705:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796544 00000100:00100000:3.0:1783349889.514736:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349889.514745:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14136:x1869977666796544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783349889.514759:0:14133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783349889.514775:0:14133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783349889.514778:0:14133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783349889.514899:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14136:x1869977666796544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349889.514907:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783349889.514946:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666796544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783349889.515023:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783349889.515032:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349889.515040:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.347259:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349890.729884:0:3290:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783349880/real 1783349880] req@ffff931fc5904e00 x1869977666790144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783349890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349890.729912:0:3290:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff931fc5904e00 x1869977666790144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783349890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349890.729922:0:3290:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783349880/real 1783349880] req@ffff931fc5904700 x1869977666790016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783349890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349890.729932:0:3290:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff931fc5904700 x1869977666790016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783349890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783349890.729949:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783349890.729971:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783349890.729982:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666790144:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783349890.729987:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320f70f3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783349890.729993:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783349890.729996:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666790016:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783349890.730366:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3291:1869977666796672:0@lo:400:kworker.0 00000100:00100000:1.0:1783349890.730443:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349890.730643:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796672 00000100:00100000:0.0:1783349890.730651:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796672 00000100:00100000:0.0:1783349890.730694:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349890.730702:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:3291:x1869977666796672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783349890.730762:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783349890.730766:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783349890.730769:0:8:0:(import.c:65:import_set_state_nolock()) ffff9320f70f3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349890.730774:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 267 00000100:00080000:2.0:1783349890.730778:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783349890.730783:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9320f70f3000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349890.730823:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5905180 x1869977666796800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349890.730837:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783349890.730841:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783349890.730842:0:8:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349890.730845:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 267 00000100:00080000:2.0:1783349890.730848:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783349890.730851:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9320c8673000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349890.730869:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5907100 x1869977666796928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349890.733274:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:3291:x1869977666796672:12345-0@lo:400:kworker.0 Request processed in 2564us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349890.733288:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783349890.733348:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666796800:0@lo:8:kworker.0 00000100:00100000:0.0:1783349890.733402:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349890.733442:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666796928:0@lo:8:kworker.0 00000100:00100000:0.0:1783349890.733464:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349890.733662:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3291:1869977666796672:0@lo:400:kworker.0 00000100:00100000:1.0:1783349890.733680:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349890.733687:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666797056:0@lo:400:kworker.0 00000100:00100000:1.0:1783349890.733714:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349890.733753:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797056 00000100:00100000:1.0:1783349890.733759:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797056 00000100:00100000:1.0:1783349890.733830:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349890.733839:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666797056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349890.733887:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666797056:12345-0@lo:400:kworker.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349890.733894:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783349890.733923:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5904a80 x1869977666797056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349890.733934:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666797056:0@lo:400:kworker.0 00000100:00100000:3.0:1783349890.734014:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796800 00000100:00100000:3.0:1783349890.734019:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796800 00000100:00100000:3.0:1783349890.734153:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666796928 00000100:00100000:3.0:1783349890.734165:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666796928 00000100:00100000:1.0:1783349890.734385:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349890.734391:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1869977666796800:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783349890.734414:0:14776:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1783349890.734437:0:14776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a484773e5 00002000:00100000:1.0:1783349890.734450:0:14776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9320f76a3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783349890.734453:0:14776:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783349890.734456:0:14776:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783349890.734860:0:14776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783349890.734883:0:14776:0:(import.c:65:import_set_state_nolock()) ffff9320f76a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349890.734987:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1869977666796800:12345-0@lo:8:kworker.0 Request processed in 593us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349890.735005:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783349890.735021:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349890.735025:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1869977666796928:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783349890.735037:0:14776:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783349890.735076:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1869977666796928:12345-0@lo:8:kworker.0 Request processed in 49us (1611us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783349890.735083:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349890.735543:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349890.735555:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666797184:0@lo:400:kworker.0 00000100:00100000:3.0:1783349890.735587:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349890.736883:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797184 00000100:00100000:1.0:1783349890.736892:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797184 00000100:00100000:1.0:1783349890.736955:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783349890.736966:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666797184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349890.737031:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666797184:12345-0@lo:400:kworker.0 Request processed in 68us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349890.737038:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783349890.737092:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5904a80 x1869977666797184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783349890.737105:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666797184:0@lo:400:kworker.0 00000100:00080000:2.0:1783349890.737184:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783349890.738629:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5905180 x1869977666796800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349890.738642:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783349890.738651:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783349890.738659:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783349890.738665:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783349890.738668:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320f70f3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783349890.740203:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783349890.740219:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666796800:0@lo:8:kworker.0 00000100:00080000:0.0:1783349890.740250:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783349890.740261:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783349890.740264:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666796928:0@lo:8:kworker.0 00000004:00080000:1.0:1783349890.741304:0:14161:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783349890.741755:0:14161:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 277803962487ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783349890.744484:0:14162:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1783349890.744509:0:14162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14162:1869977666797440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783349890.744577:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349890.744603:0:14162:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783349890.744623:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666797312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349890.744647:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349890.744689:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797440 00000100:00100000:2.0:1783349890.744697:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797440 00000100:00100000:2.0:1783349890.744749:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349890.744759:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1869977666797440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783349890.747213:0:14774:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783349890.747223:0:14774:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1783349890.747229:0:14774:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:3.0:1783349890.752204:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349890.752240:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797312 00000100:00100000:3.0:1783349890.752251:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797312 00000100:00100000:3.0:1783349890.752298:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783349890.752308:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666797312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349890.752344:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349890.752432:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666797312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (7783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349890.752439:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783349890.752525:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5904380 x1869977666797312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349890.752545:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666797312:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1783349890.753737:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.753748:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.753764:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.753768:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.753774:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.753953:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.753977:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.753984:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754069:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.754082:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.754087:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754095:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.754099:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754107:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754124:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754131:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d04a422/0x68b4a22a484773ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754147:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.754156:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.754158:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.754564:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.754570:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754580:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.754582:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.754586:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754594:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754601:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754608:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754622:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.754630:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.754634:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754641:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.754645:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754662:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754674:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754681:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005440bdab/0x68b4a22a484773f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.754695:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.754697:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.754698:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.755394:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.755401:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755410:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.755413:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.755417:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755427:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755435:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755448:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755502:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349890.755899:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.755906:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755914:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.755916:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.755921:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755929:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755937:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.755945:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.755994:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349890.756012:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756020:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349890.756023:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756031:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756068:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756075:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c94d76/0x68b4a22a484773fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756091:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349890.756094:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756099:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349890.756102:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756108:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756117:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.756123:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349890.756124:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349890.756126:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.756235:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783349890.756240:0:14774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6b9738/0x68b4a22a48477401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349890.756625:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.756630:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.756639:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.756642:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.756646:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.756655:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.756662:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.756669:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.757195:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349890.757589:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.757597:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.757607:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.757610:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.757619:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.757630:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.757638:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.757646:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.757761:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783349890.757768:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.757785:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97a00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349890.758094:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758107:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758122:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758131:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fbb4d38/0x68b4a22a48477408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758147:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349890.758151:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758157:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003c00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349890.758161:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758168:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758177:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349890.758190:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349890.758192:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349890.758194:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.758272:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783349890.758277:0:14774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd937c18/0x68b4a22a4847740f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758296:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349890.758298:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.758769:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.758775:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758785:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.758788:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.758812:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758822:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758836:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758844:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758859:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.758867:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.758871:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758878:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.758881:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758889:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758901:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758908:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c1147e3/0x68b4a22a48477416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.758921:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.758928:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.758930:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.759323:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.759329:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759337:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.759340:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.759344:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759353:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759362:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759369:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759382:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.759389:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.759392:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759398:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.759401:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759417:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759428:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759434:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000785932fc/0x68b4a22a4847741d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759448:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.759450:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.759451:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.759821:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.759827:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759836:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.759839:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.759843:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759852:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759859:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759872:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759885:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.759894:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.759897:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759904:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.759907:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759915:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759926:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759933:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008864df49/0x68b4a22a48477424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.759945:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.759946:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.759948:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.760333:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.760345:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760354:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.760357:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.760361:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760371:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760378:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760385:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760398:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.760408:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.760411:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760417:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003e00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.760420:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760426:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760443:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760451:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c263f8b/0x68b4a22a4847742b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760465:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.760467:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.760469:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.760858:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.760865:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760874:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.760877:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.760881:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760890:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760898:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760906:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760928:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.760937:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.760941:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760947:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.760950:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760959:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760970:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760977:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d565d3d9/0x68b4a22a48477432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.760991:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.760993:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.760995:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.761373:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.761379:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761387:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.761395:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.761399:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761409:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761417:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761423:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761436:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.761445:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.761448:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761455:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.761458:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761465:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761475:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761492:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a58089ca/0x68b4a22a48477439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761505:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.761506:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.761508:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.761867:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.761872:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761880:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.761883:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.761887:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761896:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761904:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761911:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761922:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.761929:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.761937:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761943:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002a00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.761946:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761954:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761964:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761971:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e34a9829/0x68b4a22a48477440 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.761983:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.761985:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.761986:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.762541:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.762548:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.762557:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.762560:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.762563:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.762583:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.762590:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.762598:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.762624:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349890.763031:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.763037:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763045:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.763048:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.763052:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763072:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763080:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763097:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763110:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783349890.763121:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349890.763124:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763131:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002c00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.763134:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763143:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763155:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763161:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49d4881/0x68b4a22a48477447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763175:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.763178:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763193:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.763196:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763203:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763213:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763220:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a4847744e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763232:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.763234:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.763235:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.763597:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.763603:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763611:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.763614:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.763618:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763626:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763640:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763647:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763661:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.763669:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.763672:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763679:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.763682:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763690:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763701:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763709:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed4540b1/0x68b4a22a48477455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.763721:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.763727:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.763729:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.764156:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.764162:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764172:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.764175:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.764179:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764188:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764196:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764205:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764220:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.764228:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.764231:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764238:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.764241:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764259:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764271:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764278:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003555b9ca/0x68b4a22a4847745c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764292:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.764294:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.764296:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.764675:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.764682:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764692:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.764695:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.764699:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764709:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764718:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764731:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764743:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.764751:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.764755:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764762:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.764765:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764772:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764784:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764816:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e8124a/0x68b4a22a48477463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.764830:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.764832:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.764833:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.765271:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783349890.765278:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.765284:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765292:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.765295:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.765299:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765308:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765316:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765322:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765347:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349890.765706:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.765712:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765721:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.765724:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.765727:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765736:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765748:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765754:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765767:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783349890.765776:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349890.765780:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765787:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.765808:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765817:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765829:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765835:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035183b55/0x68b4a22a4847746a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765849:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.765856:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765863:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.765866:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765873:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765883:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765891:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc14916/0x68b4a22a48477471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.765903:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.765905:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.765906:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349890.766170:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.766275:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.766281:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766290:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.766293:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.766297:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766315:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766323:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766330:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766342:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.766348:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.766352:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766358:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.766361:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766369:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766379:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766386:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a52574d2/0x68b4a22a48477478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766404:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.766406:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.766408:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.766828:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.766835:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766843:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.766846:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.766850:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766858:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766866:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766874:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.766885:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349890.767264:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.767270:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767287:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.767290:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.767293:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767301:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767309:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767316:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767330:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783349890.767339:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349890.767343:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767349:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaae00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.767353:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767361:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767383:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767391:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab2d7fd9/0x68b4a22a4847747f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767405:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.767409:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767415:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.767418:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767425:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767434:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767440:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056498c3d/0x68b4a22a48477486 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767451:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.767452:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.767458:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.767884:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.767891:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767900:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.767903:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.767907:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767916:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767925:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767932:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767944:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.767951:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.767955:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767962:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.767966:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767984:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.767996:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768003:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000322e9c22/0x68b4a22a4847748d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768016:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.768018:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.768020:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.768564:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.768571:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768580:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.768583:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.768587:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768596:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768604:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768621:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768636:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.768646:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.768649:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768656:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eabe00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.768659:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768667:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768677:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768684:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a6809ee/0x68b4a22a48477494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.768696:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.768697:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.768699:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.769091:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.769116:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769125:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.769127:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.769131:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769140:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769147:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769156:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769192:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.769199:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.769203:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769209:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.769213:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769220:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769235:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769242:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b7995b/0x68b4a22a4847749b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769253:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.769255:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.769257:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349890.769277:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349890.769621:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349890.769627:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769635:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=277s v=(0 0) 00010000:00010000:2.0:1783349890.769638:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349890.769642:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769650:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769658:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769665:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769687:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349890.769695:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349890.769698:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769705:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349890.769708:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769718:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769728:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769735:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1cdd770/0x68b4a22a484774a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349890.769747:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.769749:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349890.769750:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783349890.769942:0:14774:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1783349890.770036:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1869977666797440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25276us (25456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349890.770045:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349890.770119:0:14162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14162:1869977666797440:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783349890.770135:0:14162:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1783349890.770180:0:14162:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14162:1869977666797568:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783349890.770251:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349890.770282:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797568 00000100:00100000:0.0:1783349890.770289:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797568 00000100:00100000:0.0:1783349890.770337:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349890.770345:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14162:x1869977666797568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783349890.770385:0:14776:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1783349890.770887:0:14162:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6c759c0 going to sleep for 11 seconds 00000004:00080000:2.0:1783349890.775374:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783349890.779988:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14162:x1869977666797568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9635us (9729us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783349890.780001:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349890.780235:0:14162:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14162:1869977666797568:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783349890.780252:0:14162:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1783349891.369958:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349891.697560:0:15140:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783349892.394564:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783349892.586287:0:14173:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783349892.586300:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349892.586411:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783349892.586431:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1783349893.035951:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1783349893.036210:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783349893.419169:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349894.442291:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349895.466086:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783349895.785683:0:15443:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783349895.785687:0:15443:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1783349895.785836:0:15443:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff931fc10b4800 00000020:01000004:3.0:1783349895.785851:0:15443:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783349895.785864:0:15443:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1783349895.785877:0:15443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9320c75e99c0) 00000020:00000080:3.0:1783349895.785892:0:15443:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783349895.801996:0:15443:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783349895.802296:0:15443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783349895.803195:0:15443:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783349895.803428:0:15443:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783349895.803760:0:15443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783349895.804196:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1783349895.804287:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1783349895.804381:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1783349895.805090:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1783349895.805339:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1783349895.805673:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1783349895.806051:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1783349895.806286:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1783349895.806530:0:15443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00000020:00000080:3.0:1783349895.807263:0:15443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783349895.807274:0:15443:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783349895.807288:0:15443:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x68b4a22a484774b0 00000020:01000004:3.0:1783349895.807296:0:15443:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783349895.807316:0:15443:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783349895.807319:0:15443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783349895.807324:0:15443:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783349895.807345:0:15443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783349895.807348:0:15443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783349895.816086:0:15443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783349895.816124:0:15443:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.136@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783349895.816129:0:15443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783349895.816130:0:15443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349895.816131:0:15443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349895.816132:0:15443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349895.816134:0:15443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349895.816135:0:15443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349895.816136:0:15443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349895.816138:0:15443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349895.816139:0:15443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349895.816143:0:15443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783349895.816145:0:15443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349895.816147:0:15443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349895.816148:0:15443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349895.816149:0:15443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349895.816150:0:15443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349895.816151:0:15443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349895.816152:0:15443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349895.816153:0:15443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349895.816153:0:15443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783349895.816192:0:15443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783349895.816214:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666797696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783349895.816284:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349895.816440:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fb256540 going to sleep for 11 seconds 00000100:00100000:1.0:1783349895.816503:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797696 00000100:00100000:1.0:1783349895.816510:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797696 00000100:00100000:1.0:1783349895.816592:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783349895.816601:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d173b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:15443:x1869977666797696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783349895.816629:0:14134:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783349895.816638:0:14134:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783349895.816642:0:14134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783349895.824607:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d173b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:15443:x1869977666797696:12345-0@lo:253:mount.lustre.0 Request processed in 7998us (8314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.824621:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783349895.824724:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666797696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783349895.824739:0:15443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783349895.824748:0:15443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349895.824750:0:15443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349895.824751:0:15443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349895.824753:0:15443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349895.824754:0:15443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349895.824756:0:15443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349895.824757:0:15443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349895.824759:0:15443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349895.825117:0:15443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783349895.825145:0:15443:0:(tgt_mount.c:101:server_register_mount()) register mount ffff931fc10b4800 from lustre-OST0001 10000000:01000000:3.0:1783349895.825188:0:15443:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783349895.825191:0:15443:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783349895.825198:0:15443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9320d235b380 local copy 00010000:00010000:3.0:1783349895.825219:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349895.825439:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666797824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783349895.825479:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349895.825561:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c84d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.826465:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797824 00000100:00100000:0.0:1783349895.826477:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797824 00000100:00100000:0.0:1783349895.826535:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783349895.826545:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d173a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:15443:x1869977666797824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783349895.827109:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d173a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:15443:x1869977666797824:12345-0@lo:501:mount.lustre.0 Request processed in 562us (1626us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349895.827117:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783349895.827194:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666797824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783349895.827278:0:15443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783349895.827447:0:15443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783349895.827456:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349895.827466:0:15443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97e00/0x68b4a22a4847725d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477264 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349895.827492:0:15443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff931fc10b4800 10000000:01000000:3.0:1783349895.827497:0:15443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783349895.827503:0:15443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783349895.827511:0:15443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783349895.827517:0:15443:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783349895.827520:0:15443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783349895.827551:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349895.827559:0:15443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349895.827568:0:15443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349895.827583:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666797952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783349895.827613:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349895.827686:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c84d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.827733:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666797952 00000100:00100000:0.0:1783349895.827738:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666797952 00000100:00100000:0.0:1783349895.827829:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783349895.827836:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:15443:x1869977666797952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783349895.827847:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349895.827859:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fb4a6400/0x68b4a22a484774be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484774b7 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.827882:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a6400/0x68b4a22a484774be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484774b7 expref: 17 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.827892:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fb4a6400/0x68b4a22a484774be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484774b7 expref: 17 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.827901:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6400, rc 0) 00000100:00100000:0.0:1783349895.827945:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666797952:12345-0@lo:101:mount.lustre.0 Request processed in 110us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.827952:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783349895.828030:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666797952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783349895.828043:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774be expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.828053:0:15443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484774be expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349895.828653:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783349895.829421:0:15443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349895.829634:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783349895.829677:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783349895.829711:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783349895.829773:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783349895.829865:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783349895.829902:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783349895.829980:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783349895.829988:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783349895.830052:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349895.830094:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.830129:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.830140:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798080 00000100:00100000:0.0:1783349895.830148:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798080 00000100:00100000:0.0:1783349895.830191:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783349895.830213:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783349895.830583:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798080:12345-0@lo:501:mount.lustre.0 Request processed in 383us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.830591:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783349895.830672:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349895.830706:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783349895.830743:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.830761:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.830840:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798208 00000100:00100000:0.0:1783349895.830844:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798208 00000100:00100000:0.0:1783349895.830869:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783349895.830875:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d173b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783349895.831164:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d173b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798208:12345-0@lo:503:mount.lustre.0 Request processed in 288us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.831171:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783349895.831248:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783349895.832109:0:15443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783349895.832164:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349895.832196:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.832230:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.832249:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798336 00000100:00100000:0.0:1783349895.832255:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798336 00000100:00100000:0.0:1783349895.832290:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783349895.832297:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783349895.832485:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798336:12345-0@lo:502:mount.lustre.0 Request processed in 188us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.832492:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783349895.832544:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783349895.832863:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783349895.833010:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783349895.833051:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783349895.833101:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783349895.833140:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783349895.833173:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783349895.833288:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783349895.833325:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783349895.833367:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783349895.833408:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349895.833466:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.833500:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681540 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.833636:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798464 00000100:00100000:0.0:1783349895.833643:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798464 00000100:00100000:0.0:1783349895.833681:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783349895.833689:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d170bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783349895.833905:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d170bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798464:12345-0@lo:502:mount.lustre.0 Request processed in 215us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.833912:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783349895.833927:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783349895.833999:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1783349895.834008:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1783349895.835147:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783349895.835156:0:15444:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783349895.835164:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783349895.835166:0:15444:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783349895.835172:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783349895.835188:0:15444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9320d235cd40) 00000020:00000080:1.0:1783349895.835277:0:15444:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783349895.835286:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783349895.835354:0:15444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931fc10b4800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783349895.835361:0:15444:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783349895.835370:0:15444:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x68b4a22a484774cc 00010000:00010000:1.0:1783349895.840352:0:15444:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1783349895.841031:0:15444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1783349895.842988:0:15444:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783349895.844733:0:15444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783349895.844743:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349895.844749:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349895.844751:0:15444:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783349895.844767:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349895.844771:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349895.844773:0:15444:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783349895.844776:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783349895.844777:0:15444:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783349895.844779:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349895.844781:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349895.844782:0:15444:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783349895.844784:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783349895.844787:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349895.844788:0:15444:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783349895.845418:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783349895.845475:0:15444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783349895.845487:0:15444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783349895.845488:0:15444:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783349895.845497:0:15444:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783349895.845910:0:15443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783349895.845937:0:15443:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783349895.845992:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774be expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.846006:0:15443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320c0031a00/0x68b4a22a484774b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774be expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349895.846014:0:15443:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff931fc10b4800 from 1 10000000:01000000:1.0:1783349895.846017:0:15443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349895.846053:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.846060:0:15443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.846071:0:15443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349895.846095:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783349895.846162:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.846278:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798592 00000100:00100000:0.0:1783349895.846286:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798592 00000100:00100000:0.0:1783349895.846333:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783349895.846341:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:15443:x1869977666798592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783349895.846354:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349895.846365:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484774d3 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.846387:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.846398:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.846407:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6200, rc 0) 00000100:00100000:0.0:1783349895.846439:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798592:12345-0@lo:101:mount.lustre.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.846447:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783349895.846511:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d06813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783349895.846534:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783349895.846548:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.846566:0:15443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349895.847073:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783349895.847413:0:15443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349895.847623:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783349895.847659:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783349895.847708:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783349895.847715:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783349895.847764:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349895.847824:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.847851:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d06813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.848203:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798720 00000100:00100000:0.0:1783349895.848209:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798720 00000100:00100000:0.0:1783349895.848254:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349895.848263:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783349895.848495:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798720:12345-0@lo:501:mount.lustre.0 Request processed in 232us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.848503:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783349895.848551:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783349895.848588:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783349895.848630:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.848651:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798848 00000100:00100000:0.0:1783349895.848661:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798848 00000100:00100000:0.0:1783349895.848682:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349895.848688:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d170b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783349895.848988:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d170b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798848:12345-0@lo:503:mount.lustre.0 Request processed in 299us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.848994:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783349895.849021:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.849033:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783349895.849636:0:15443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783349895.849693:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783349895.850610:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.850698:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0a28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.850945:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666798976 00000100:00100000:3.0:1783349895.850954:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666798976 00000100:00100000:3.0:1783349895.851012:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783349895.851024:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d170a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783349895.851340:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d170a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666798976:12345-0@lo:502:mount.lustre.0 Request processed in 318us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349895.851349:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783349895.851430:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666798976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783349895.852089:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783349895.852149:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783349895.852192:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783349895.852231:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783349895.852270:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783349895.852334:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783349895.852381:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783349895.852419:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783349895.852500:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349895.852548:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.852584:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.852711:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799104 00000100:00100000:0.0:1783349895.852719:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799104 00000100:00100000:0.0:1783349895.852777:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783349895.852935:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d170b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666799104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783349895.853284:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d170b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666799104:12345-0@lo:502:mount.lustre.0 Request processed in 491us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.853295:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783349895.854092:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783349895.854295:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783349895.854326:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783349895.855738:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349895.855750:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349895.855752:0:15448:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783349895.855760:0:15448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff931fc10b4800 00000020:00000080:0.0:1783349895.855763:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349895.855779:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349895.855783:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349895.855784:0:15448:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783349895.855788:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349895.856704:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349895.856710:0:15448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783349895.856718:0:15448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff931fc10b4800 00000020:00000080:0.0:1783349895.856722:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349895.856766:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349895.856770:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349895.856772:0:15448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783349895.856775:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783349895.856778:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349895.856779:0:15448:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783349895.856783:0:15448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff931fc10b4800 00000020:00000080:0.0:1783349895.856785:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783349895.856856:0:15448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783349895.856860:0:15448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783349895.856862:0:15448:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783349895.856866:0:15448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783349895.856988:0:15443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783349895.857015:0:15443:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349895.857038:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.857060:0:15443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349895.857107:0:15443:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783349895.857110:0:15443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff931fc10b4800 10000000:01000000:1.0:1783349895.857113:0:15443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff931fc10b4800 10000000:01000000:1.0:1783349895.857117:0:15443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783349895.857122:0:15443:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff931fc10b4800 from 1 10000000:01000000:1.0:1783349895.857125:0:15443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783349895.857159:0:15443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.857167:0:15443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.857178:0:15443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349895.857205:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783349895.857264:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.857312:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681480 going to sleep for 11 seconds 00000100:00100000:0.0:1783349895.857418:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799232 00000100:00100000:0.0:1783349895.857425:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799232 00000100:00100000:0.0:1783349895.857474:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783349895.857483:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d170ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666799232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783349895.857497:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349895.857577:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fb4a7200/0x68b4a22a484774e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a484774e1 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.857670:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a7200/0x68b4a22a484774e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a484774e1 expref: 19 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.857683:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fb4a7200/0x68b4a22a484774e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484774e1 expref: 19 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.857748:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7200, rc 0) 00000100:00100000:0.0:1783349895.857823:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d170ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799232:12345-0@lo:101:mount.lustre.0 Request processed in 340us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.857830:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783349895.857843:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783349895.857856:0:15443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774e8 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349895.857866:0:15443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a484774e8 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349895.858984:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1783349895.859292:0:15443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349895.859602:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783349895.859775:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783349895.859905:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783349895.860108:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783349895.860154:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783349895.860222:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783349895.860272:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783349895.860322:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783349895.860397:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783349895.860455:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783349895.860507:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783349895.860578:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783349895.860636:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783349895.861881:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783349895.862030:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783349895.862066:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783349895.862099:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783349895.862847:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783349895.862984:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783349895.863041:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783349895.863106:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783349895.863152:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783349895.863194:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783349895.863251:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783349895.863296:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783349895.863335:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783349895.863384:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783349895.863424:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783349895.863464:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783349895.863535:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1783349895.863578:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1783349895.863620:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1783349895.864807:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1783349895.864896:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1783349895.865021:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1783349895.865091:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1783349895.865121:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1783349895.865218:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1783349895.865225:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1783349895.865333:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349895.865397:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.865447:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.865669:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799360 00000100:00100000:3.0:1783349895.865677:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799360 00000100:00100000:3.0:1783349895.865724:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783349895.865734:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783349895.866042:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799360:12345-0@lo:501:mount.lustre.0 Request processed in 309us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349895.866050:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783349895.866071:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783349895.866111:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783349895.866152:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.866186:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.866295:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799488 00000100:00100000:3.0:1783349895.866300:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799488 00000100:00100000:3.0:1783349895.866331:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783349895.866338:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783349895.866869:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783349895.867513:0:15443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783349895.867585:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783349895.868846:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349895.868886:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0681480 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.870035:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799488:12345-0@lo:503:mount.lustre.0 Request processed in 3690us (3875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349895.870049:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783349895.870106:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799616 00000100:00100000:3.0:1783349895.870113:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799616 00000100:00100000:3.0:1783349895.870158:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783349895.870166:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783349895.870574:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799616:12345-0@lo:502:mount.lustre.0 Request processed in 407us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349895.870581:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783349895.870643:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783349895.871106:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783349895.871187:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783349895.871250:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783349895.871309:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783349895.871377:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783349895.871481:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783349895.871527:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783349895.871572:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783349895.871631:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783349895.871682:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783349895.871738:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783349895.871788:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783349895.871851:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783349895.871887:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783349895.871946:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783349895.872005:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783349895.872043:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783349895.872098:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783349895.872141:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783349895.872181:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783349895.872239:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783349895.872291:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783349895.872330:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783349895.872389:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783349895.872431:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783349895.872474:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783349895.872563:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783349895.872608:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783349895.872655:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783349895.872715:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783349895.872766:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783349895.872832:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1783349895.872877:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1783349895.872942:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783349895.875492:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783349895.875620:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783349895.875663:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783349895.875695:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783349895.875751:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783349895.875813:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783349895.875865:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783349895.876074:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349895.876120:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c8602600 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.876234:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799744 00000100:00100000:3.0:1783349895.876242:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799744 00000100:00100000:3.0:1783349895.876308:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783349895.876319:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783349895.876635:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666799744:12345-0@lo:502:mount.lustre.0 Request processed in 317us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349895.876644:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783349895.876705:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666799744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783349895.876787:0:15443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783349895.876821:0:15443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783349895.880186:0:15453:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783349895.880203:0:15453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9320fb12b380) 00000020:00000080:2.0:1783349895.880225:0:15453:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1783349895.880361:0:15453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff931fc10b4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783349895.880365:0:15453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff931fc10b4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783349895.880368:0:15453:0:(obd_mount.c:701:lustre_put_lsi()) put ffff931fc10b4800 3 00010000:00080000:2.0:1783349895.880397:0:15453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9320f77da000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.136@tcp at head 00010000:00010000:2.0:1783349895.884379:0:15453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1783349895.884479:0:15453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783349895.884524:0:15453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783349895.884536:0:15453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x68b4a22a484774f6 00000100:00080000:2.0:1783349895.884546:0:15453:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783349895.884552:0:15453:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9320f77da000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349895.884588:0:15453:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5907800 x1869977666799872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783349895.884615:0:15453:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783349895.884688:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666799872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783349895.885197:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.885276:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666799872 00000100:00100000:0.0:1783349895.885283:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666799872 00000100:00100000:0.0:1783349895.885316:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349895.885323:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1869977666799872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783349895.885347:0:14139:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:0.0:1783349895.885393:0:14139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x68b4a22a484774fd 00000004:00100000:0.0:1783349895.885410:0:14139:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783349895.885445:0:14139:0:(import.c:65:import_set_state_nolock()) ffff9320c53d7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349895.885513:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1869977666799872:12345-0@lo:38:llog_process_th.0 Request processed in 188us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.885523:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783349895.885574:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5907800 x1869977666799872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783349905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349895.885586:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783349895.885594:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1783349895.885601:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783349895.885606:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783349895.885608:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320f77da000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783349895.885621:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1869977666799872:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783349895.885929:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783349895.885934:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783349895.885936:0:8:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349895.885941:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 277 00000100:00080000:2.0:1783349895.885945:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783349895.885949:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9320c8673000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349895.885981:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5904000 x1869977666800128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783349895.886038:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666800384:0@lo:400:kworker.0 00000100:00100000:0.0:1783349895.886060:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666800000:0@lo:400:kworker.0 00000100:00100000:2.0:1783349895.886077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.886101:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349895.886119:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800384 00000100:00100000:2.0:1783349895.886125:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800384 00000100:00100000:0.0:1783349895.886132:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349895.886140:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666800256:0@lo:400:kworker.0 00000100:00100000:2.0:1783349895.886165:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349895.886171:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349895.886176:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666800384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349895.886218:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666800384:12345-0@lo:400:kworker.0 Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349895.886224:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783349895.886235:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800256 00000100:00100000:2.0:1783349895.886237:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800256 00000100:00100000:0.0:1783349895.886257:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800000 00000100:00100000:0.0:1783349895.886263:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800000 00000100:00100000:2.0:1783349895.886266:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783349895.886276:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666800256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349895.886306:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349895.886314:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666800256:12345-0@lo:400:kworker.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.886317:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666800000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349895.886325:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783349895.886359:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5905500 x1869977666800384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349895.886364:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666800000:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.886379:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349895.886381:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666800384:0@lo:400:kworker.0 00010000:00080000:0.0:1783349895.886424:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff931fc5906d80 x1869977666800256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783349895.886434:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666800256:0@lo:400:kworker.0 00000100:00100000:0.0:1783349895.886444:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783349895.886510:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666800000:0@lo:400:kworker.0 00000100:00100000:0.0:1783349895.886534:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666800128:0@lo:8:kworker.0 00000100:00100000:0.0:1783349895.886565:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.886598:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800128 00000100:00100000:0.0:1783349895.886602:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800128 00000100:00080000:3.0:1783349895.886615:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783349895.886622:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349895.886625:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783349895.886631:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1869977666800128:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783349895.887339:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1869977666800128:12345-0@lo:8:kworker.0 Request processed in 41us (108us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783349895.887357:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783349895.887396:0:3290:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783349895.887402:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783349895.887407:0:3290:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783349895.887411:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666800128:0@lo:8:kworker.0 00000040:00080000:3.0:1783349895.888132:0:15453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1783349895.888182:0:15443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783349895.888208:0:15443:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783349895.888223:0:15443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774e8 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349895.888233:0:15443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320faacac00/0x68b4a22a484774e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a484774e8 expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783349895.888277:0:15443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783349895.888283:0:15443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349895.888285:0:15443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349895.888286:0:15443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349895.888287:0:15443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349895.888288:0:15443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349895.888290:0:15443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349895.888292:0:15443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349895.888293:0:15443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783349895.888297:0:15443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783349895.888299:0:15443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783349895.888301:0:15443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349895.888302:0:15443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349895.888303:0:15443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349895.888303:0:15443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349895.888305:0:15443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349895.888306:0:15443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349895.888307:0:15443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349895.888308:0:15443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783349895.888327:0:15443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783349895.888344:0:15443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666800512:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783349895.888401:0:15443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349895.888429:0:15443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e6ae4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.889048:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800512 00000100:00100000:3.0:1783349895.889055:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800512 00000100:00100000:3.0:1783349895.889095:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783349895.889103:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:15443:x1869977666800512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783349895.889128:0:14133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783349895.889140:0:14133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783349895.911634:0:14133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783349895.911672:0:14133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783349895.913365:0:14155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783349895.913374:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783349895.913399:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349895.913418:0:14155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 19 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349895.913428:0:14155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349895.913467:0:14155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 19 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349895.913480:0:14155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 19 pid: 14132 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349895.913495:0:14155:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14155:1869977666800640:0@lo:104: 00000100:00100000:2.0:1783349895.913633:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349895.914116:0:14155:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c8602c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349895.914322:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800640 00000100:00100000:3.0:1783349895.914330:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800640 00000100:00100000:3.0:1783349895.914408:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783349895.914418:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14155:x1869977666800640:12345-0@lo:104: 00010000:00010000:3.0:1783349895.914431:0:14122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349895.914608:0:14122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349895.914614:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:14155:x1869977666800640:12345-0@lo:104: Request processed in 199us (982us total) trans 0 rc 0/0 00010000:00010000:0.0:1783349895.914618:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783349895.914621:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783349895.914624:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.914631:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacb600 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:0.0:1783349895.914635:0:14128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.914643:0:14128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783349895.914649:0:14128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783349895.914721:0:14128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783349895.914748:0:14155:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14155:1869977666800640:0@lo:104: 00010000:00010000:2.0:1783349895.914774:0:14155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.914814:0:14128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.914821:0:14128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783349895.914853:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349895.914869:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666800768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349895.914872:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320faacb600/0x68b4a22a484773d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484773de expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.914889:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349895.914890:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349895.914892:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349895.914904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349895.914990:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800768 00000100:00100000:0.0:1783349895.914995:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800768 00010000:00010000:0.0:1783349895.915014:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 20 pid: 14132 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349895.915135:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349895.915142:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+20:3294:x1869977666800768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783349895.915154:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349895.915159:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 20 pid: 14132 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915169:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 20 pid: 14132 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915182:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac97400/0x68b4a22a484773de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484773d7 expref: 20 pid: 14132 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915194:0:14124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915202:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783349895.915225:0:14124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006801579s 00010000:00010000:0.0:1783349895.915230:0:14124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915238:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915244:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915250:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915255:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349895.915259:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915265:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915276:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349895.915282:0:14155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349895.915284:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349895.915288:0:14155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349895.915294:0:14155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff931fc4eab800/0x68b4a22a48477504 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349895.915316:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666800768:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.915322:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349895.915433:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666800768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349895.916687:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:15443:x1869977666800512:12345-0@lo:253:mount.lustre.0 Request processed in 27581us (28281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349895.916713:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783349895.916786:0:15443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:15443:1869977666800512:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783349895.916917:0:15443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783349895.916920:0:15443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783349895.916922:0:15443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783349895.916924:0:15443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783349895.916925:0:15443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783349895.916926:0:15443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783349895.916927:0:15443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783349895.916929:0:15443:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783349895.916931:0:15443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783349895.916932:0:15443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783349895.916947:0:15443:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783349895.921991:0:15443:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783349895.922164:0:15443:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783349895.922329:0:15443:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783349895.922483:0:15443:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783349895.922707:0:15443:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783349895.922968:0:15443:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783349895.924234:0:15443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783349895.961885:0:15443:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783349895.961894:0:15443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783349895.961933:0:15443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783349895.961993:0:15443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783349895.962007:0:15443:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783349895.962032:0:15443:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1783349896.042158:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666800896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349896.042227:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349896.042341:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666800896 00000100:00100000:0.0:1783349896.042348:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666800896 00000100:00100000:0.0:1783349896.042400:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349896.042409:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666800896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349896.042445:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349896.042492:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666800896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349896.042499:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349896.042583:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666800896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783349896.494219:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349897.514865:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783349897.583677:0:14136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783349897.583695:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9320f7b31800 from 8 10000000:01000000:0.0:1783349897.583704:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783349897.583752:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.583763:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349897.583774:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349897.583825:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320e40ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666801024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783349897.583889:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349897.583946:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783349897.586151:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801024 00000100:00100000:3.0:1783349897.586169:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801024 00000100:00100000:3.0:1783349897.586236:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783349897.586255:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666801024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783349897.586271:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349897.586291:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c0030400/0x68b4a22a48477512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a4847750b expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.586316:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c0030400/0x68b4a22a48477512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a4847750b expref: 19 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.586328:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c0030400/0x68b4a22a48477512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847750b expref: 19 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349897.586336:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c0030400, rc 0) 00000100:00100000:3.0:1783349897.586413:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666801024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349897.586420:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783349897.586566:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320e40ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666801024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349897.586590:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477512 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349897.586600:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a48477512 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349897.586662:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666801152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783349897.586701:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349897.586740:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ce105c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783349897.586788:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801152 00000100:00100000:3.0:1783349897.586822:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801152 00000100:00100000:3.0:1783349897.586859:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783349897.586866:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666801152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783349897.586879:0:14133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783349897.586894:0:14133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783349897.586897:0:14133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783349897.586986:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666801152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349897.586993:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783349897.586996:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666801152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783349897.587058:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783349897.587065:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477512 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349897.587074:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fb4a7a00/0x68b4a22a4847750b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a48477512 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349898.539774:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349899.567094:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783349899.961707:0:15796:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg436-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783349900.587839:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349901.162695:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349901.162749:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666801280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349901.162911:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349901.163007:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801280 00000100:00100000:0.0:1783349901.163020:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801280 00000100:00080000:2.0:1783349901.163038:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783349901.163043:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783349901.163048:0:8:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783349901.163059:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9320c8673000 using connection 192.168.204.136@tcp/0@lo 00000100:00100000:2.0:1783349901.163091:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff931fc5907800 x1869977666801536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783349901.163103:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783349901.163118:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666801280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783349901.163185:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349901.163229:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666801408:0@lo:400:kworker.0 00000100:00100000:0.0:1783349901.163248:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666801280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.163258:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783349901.163283:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349901.163294:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666801664:0@lo:400:kworker.0 00000100:00100000:3.0:1783349901.163311:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666801920:0@lo:400:kworker.0 00000100:00100000:0.0:1783349901.163344:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349901.163346:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801408 00000100:00100000:2.0:1783349901.163352:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801408 00000100:00100000:3.0:1783349901.163378:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783349901.163403:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349901.163406:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783349901.163412:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349901.163417:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3293:x1869977666801408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349901.163424:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666801792:0@lo:400:kworker.0 00000100:00100000:0.0:1783349901.163425:0:3290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666801536:0@lo:8:kworker.0 00000100:00100000:2.0:1783349901.163473:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3293:x1869977666801408:12345-0@lo:400:kworker.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.163481:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349901.163487:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349901.163491:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783349901.163545:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801664 00000100:00100000:3.0:1783349901.163550:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801920 00000100:00100000:0.0:1783349901.163550:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801664 00000100:00100000:3.0:1783349901.163557:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801920 00000100:00100000:2.0:1783349901.163570:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666801408:0@lo:400:kworker.0 00000100:00100000:3.0:1783349901.163599:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801792 00000100:00100000:3.0:1783349901.163604:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801792 00000100:00100000:3.0:1783349901.163625:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349901.163632:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666801920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349901.163677:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1869977666801920:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.163684:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783349901.163720:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349901.163732:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666801792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349901.163769:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666801792:12345-0@lo:400:kworker.0 Request processed in 40us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.163776:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349901.163782:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349901.163787:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666801664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349901.163847:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666801536 00000100:00100000:0.0:1783349901.163852:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666801536 00000100:00100000:3.0:1783349901.163878:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666801664:12345-0@lo:400:kworker.0 Request processed in 94us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.163887:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349901.163891:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783349901.163898:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3290:x1869977666801536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783349901.163926:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931fc5904700 x1869977666801792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783349901.163929:0:14775:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 288 last 0 00000100:00100000:3.0:1783349901.163947:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666801792:0@lo:400:kworker.0 00010000:00080000:3.0:1783349901.163961:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931fc5904380 x1869977666801920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783349901.163971:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1869977666801920:0@lo:400:kworker.0 00000020:00000080:0.0:1783349901.163972:0:14775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x68b4a22a48477519 00002000:00100000:0.0:1783349901.163999:0:14775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9320c8e77000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783349901.164005:0:14775:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1783349901.164007:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666801280:0@lo:13:osp-pre-0-0.0 00002000:00100000:0.0:1783349901.164010:0:14775:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783349901.164408:0:14775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783349901.164437:0:14775:0:(import.c:65:import_set_state_nolock()) ffff9320c8e76800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349901.164773:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1869977666801536:12345-0@lo:8:kworker.0 Request processed in 872us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.164784:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783349901.164840:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783349901.165011:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931fc5907800 x1869977666801536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783349921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783349901.165027:0:3290:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783349901.165037:0:3290:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783349901.165044:0:3290:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783349901.165048:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9320c8673000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783349901.165063:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783349901.165071:0:3290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1869977666801536:0@lo:8:kworker.0 00000004:00080000:2.0:1783349901.165170:0:14164:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1783349901.165192:0:14164:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14164:1869977666802176:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783349901.165233:0:14164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349901.165258:0:14164:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c8602cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349901.165276:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666802048:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783349901.165282:0:14163:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1783349901.165314:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349901.165427:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802176 00000100:00100000:3.0:1783349901.165436:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802176 00010000:00080000:2.0:1783349901.165483:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931fc5907480 x1869977666801664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783349917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349901.165496:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666801664:0@lo:400:kworker.0 00000100:00100000:3.0:1783349901.165500:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349901.165512:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14164:x1869977666802176:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783349901.166026:0:14163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288228232879ns, next at 0ns, rc = 0 00000100:00080000:0.0:1783349901.166071:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783349901.166194:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802048 00000100:00100000:0.0:1783349901.166200:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802048 00000100:00100000:0.0:1783349901.166236:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783349901.166245:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1869977666802048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783349901.166275:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349901.166338:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1869977666802048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.166347:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783349901.166374:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff931fc5907800 x1869977666802048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783349917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783349901.166400:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666802048:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1783349901.169294:0:14774:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783349901.169309:0:14774:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1783349901.169317:0:14774:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1783349901.177039:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.177055:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177072:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.177077:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.177084:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177102:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177112:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177120:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177138:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349901.177350:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349901.177364:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.177380:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eabe00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349901.177387:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.177417:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.177450:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.177460:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a48477520 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.177489:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.177491:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.177493:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.177745:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.177754:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177770:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.177773:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.177779:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177831:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177842:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177850:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177883:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349901.177900:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.177907:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177916:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.177920:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177930:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177964:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.177973:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477527 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.178001:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.178004:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.178010:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.178464:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.178470:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.178478:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.178481:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.178486:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.178495:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.178503:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.178509:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.179028:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349901.179539:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349901.179552:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.179564:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349901.179568:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.179578:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.179613:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.179621:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a4847752e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.179641:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.179643:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.179644:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.180712:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.180724:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.180738:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.180742:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.180747:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.180758:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.180767:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.180775:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.180816:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349901.180835:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349901.180847:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.180868:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaae00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349901.180873:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.180883:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.180902:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.180911:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.180957:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.180959:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.180962:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.181351:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.181358:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.181367:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.181377:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.181381:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.181392:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.181400:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.181408:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.181431:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349901.181476:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349901.181484:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.181494:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349901.181498:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.181507:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.181524:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.181542:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a4847753c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.181562:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.181564:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.181566:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.183387:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.183397:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.183411:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.183415:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.183420:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.183432:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.183441:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.183456:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.184640:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349901.184834:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349901.184842:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.184853:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349901.184873:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.184884:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.184910:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.184919:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a48477543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.184939:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.184941:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.184942:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.186010:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.186019:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186030:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.186034:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.186039:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186052:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186062:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186070:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186097:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783349901.186125:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783349901.186133:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.186142:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:0.0:1783349901.186147:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.186157:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.186171:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.186179:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dd25570/0x68b4a22a4847754a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.186209:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.186213:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783349901.186216:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.186629:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.186636:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186650:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.186653:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.186657:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186669:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186678:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186686:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.186711:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349901.187230:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.187237:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187246:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.187249:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.187254:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187264:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187286:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187294:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187315:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783349901.187327:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349901.187331:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187338:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.187342:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187350:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187364:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187372:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187388:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.187398:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187405:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaba00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.187408:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187416:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187427:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187436:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.187454:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.187456:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.187458:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.188070:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.188076:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188086:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.188089:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.188093:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188114:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188122:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188130:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188144:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349901.188153:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.188156:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188163:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.188166:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188173:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188185:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188192:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62e7009/0x68b4a22a4847755f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188215:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.188217:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.188218:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.188726:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.188733:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188743:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.188746:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.188751:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188760:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188768:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188775:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188815:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349901.188824:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.188828:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.188846:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaac00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.188850:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.190011:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.190059:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190082:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190091:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d597489f/0x68b4a22a48477566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190114:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.190117:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.190120:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.190769:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.190776:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190924:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.190929:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.190935:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190949:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190964:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190972:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.190996:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.191065:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.191081:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.191096:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.191101:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.191114:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.191141:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.191151:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7712230/0x68b4a22a4847756d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.191193:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.191196:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.191201:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.191632:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.191638:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191644:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.191647:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.191650:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191657:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191662:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191668:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191688:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783349901.191697:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.191701:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191706:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaaa00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.191708:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191713:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191723:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191728:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000687c8d24/0x68b4a22a48477574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.191742:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.191744:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.191746:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.192323:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.192330:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192339:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.192350:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.192355:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192365:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192375:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192383:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192396:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349901.192968:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.192975:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192982:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.192985:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.192989:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.192998:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193006:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193019:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193034:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783349901.193044:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349901.193049:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193057:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.193061:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193070:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193085:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193093:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3ca2ed7/0x68b4a22a4847757b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193124:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.193129:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193147:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eabc00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.193149:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.193152:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193164:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193175:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193181:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a4f2141/0x68b4a22a48477582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193197:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.193199:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.193202:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.193768:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.193772:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193779:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.193780:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.193783:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193886:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193911:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193916:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.193940:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.194241:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.194249:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194266:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaae00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.194270:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194279:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194294:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194303:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab2d7fd9/0x68b4a22a48477589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194328:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.194333:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.194341:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.194659:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.194673:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.194683:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.194693:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.194699:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.194709:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.194723:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.194731:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.194771:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.194843:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.194849:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194871:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaba00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.194876:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194887:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194909:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194917:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61e88be/0x68b4a22a48477590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.194958:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.194961:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.194965:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.195494:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.195501:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.195515:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.195519:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.195523:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.195533:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.195548:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.195555:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.195577:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.195610:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.195617:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.195625:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.195629:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.195637:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.195648:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.195655:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ddcd517/0x68b4a22a48477597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.195685:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.195687:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.195689:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.196140:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.196147:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196154:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.196160:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.196163:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196169:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196175:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196179:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196193:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.196200:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.196207:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196217:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.196221:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196230:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196244:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196252:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000322e9c22/0x68b4a22a4847759e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196270:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.196273:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.196275:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.196521:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.196525:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196530:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.196531:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.196534:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196540:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196545:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196554:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196568:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.196574:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.196580:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196598:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.196602:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196611:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196623:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196631:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056498c3d/0x68b4a22a484775a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.196649:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.196652:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.196654:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.196962:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.196968:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196977:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.196980:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.196984:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196990:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196995:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.196999:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197013:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.197029:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.197035:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197044:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa200 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.197047:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197056:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197075:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197084:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b66abb5f/0x68b4a22a484775ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197103:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.197105:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.197107:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.197373:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.197377:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197386:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.197388:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.197390:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197396:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197401:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197407:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197420:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.197425:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.197431:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197438:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eabe00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.197442:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197449:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197461:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197469:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6809ee/0x68b4a22a484775b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197499:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.197502:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.197505:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.197765:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.197771:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197778:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.197780:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.197785:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197814:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197833:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197840:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.197855:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.197874:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.197880:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197888:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eab600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.197891:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197899:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197911:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.197919:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.197921:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.197922:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.198151:0:14774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6b7995b/0x68b4a22a484775ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349901.198788:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.198827:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.198837:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.198840:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.198844:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.198854:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.198873:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.198893:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.198909:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783349901.199390:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349901.199405:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.199418:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff931fc4eaa800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349901.199423:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.199434:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783349901.199449:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783349901.199456:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.199458:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.199479:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1cdd770/0x68b4a22a484775c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.199494:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.199501:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.199507:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.199521:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.199525:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.199530:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.199534:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.199535:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.199545:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.199572:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783349901.199704:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783349901.199711:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.199721:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349901.199726:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.199744:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.199758:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.199765:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a52574d2/0x68b4a22a484775c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349901.199889:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.199892:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783349901.199893:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783349901.200129:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.200137:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200154:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.200157:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.200162:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200172:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200182:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200191:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200210:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783349901.200581:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.200587:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200593:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.200596:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.200599:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200605:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200620:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200627:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.200641:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783349901.201020:0:14774:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783349901.201025:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.201032:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1783349901.201034:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349901.201036:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.201042:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.201047:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.201053:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.201066:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1783349901.201193:0:14774:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1783349901.201279:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14164:x1869977666802176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 35767us (36044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.201288:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783349901.201337:0:14164:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14164:1869977666802176:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783349901.201352:0:14164:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1783349901.201528:0:14164:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14164:1869977666802304:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783349901.201564:0:14164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349901.201603:0:14164:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c8602cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349901.201621:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802304 00000100:00100000:2.0:1783349901.201627:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802304 00000100:00100000:2.0:1783349901.201666:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349901.201675:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14164:x1869977666802304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783349901.201705:0:14776:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1783349901.202154:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783349901.202162:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202171:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.202176:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202186:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202215:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202223:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc14916/0x68b4a22a484775cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202242:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783349901.202247:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202254:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002600 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.202259:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202269:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202286:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202295:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035183b55/0x68b4a22a484775d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202319:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783349901.202323:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202337:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:2.0:1783349901.202340:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202346:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202358:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202362:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0e8124a/0x68b4a22a484775dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.202375:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.202377:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349901.202380:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349901.202671:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349901.207894:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14164:x1869977666802304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6214us (6324us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783349901.207907:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783349901.210245:0:14164:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5906d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14164:1869977666802304:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783349901.210279:0:14164:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1783349901.212444:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1783349901.610100:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349901.725154:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.725203:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283200 00000100:00100000:0.0:1783349901.725213:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283200 00000100:00100000:0.0:1783349901.725263:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:0.0:1783349901.725272:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1869977655283200:12345-192.168.204.36@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783349901.725327:0:14134:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6bbe73cc-1856-47c4-9e27-5609d833c88a@192.168.204.36@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1783349901.725354:0:14134:0:(genops.c:1406:class_connect()) connect: client 6bbe73cc-1856-47c4-9e27-5609d833c88a, cookie 0x68b4a22a484775e4 00000100:00080000:0.0:1783349901.725494:0:14134:0:(import.c:65:import_set_state_nolock()) ffff9320c8e77800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349901.725554:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+5:2358:x1869977655283200:12345-192.168.204.36@tcp:250:mount.lustre.0 Request processed in 281us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.725562:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 71 00000100:00100000:1.0:1783349901.731198:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.731440:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283328 00000100:00100000:2.0:1783349901.731451:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283328 00000100:00100000:2.0:1783349901.731523:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:2.0:1783349901.731534:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+5:13675:x1869977655283328:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783349901.731567:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349901.731586:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9002600/0x68b4a22a484775eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd56 expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.731616:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002600/0x68b4a22a484775eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd56 expref: 6 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.731625:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9002600/0x68b4a22a484775eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd56 expref: 6 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.731632:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002600, rc 0) 00000100:00100000:2.0:1783349901.731681:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+6:13675:x1869977655283328:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 151us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.731686:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 72 00000100:00100000:1.0:1783349901.733250:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.733310:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283456 00000100:00100000:0.0:1783349901.733319:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283456 00000100:00100000:0.0:1783349901.733366:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:0.0:1783349901.733375:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+6:13675:x1869977655283456:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783349901.733624:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+6:13675:x1869977655283456:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 250us (379us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783349901.733632:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 73 00000100:00100000:0.0:1783349901.735033:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349901.735094:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283584 00000100:00100000:1.0:1783349901.735101:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283584 00000100:00100000:1.0:1783349901.735144:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:1.0:1783349901.735153:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+6:13675:x1869977655283584:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783349901.735166:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349901.735181:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb400/0x68b4a22a484775f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd5d expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.735206:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb400/0x68b4a22a484775f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd5d expref: 7 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.735216:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb400/0x68b4a22a484775f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd5d expref: 7 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349901.735224:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb400, rc 0) 00000100:00100000:1.0:1783349901.735267:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+7:13675:x1869977655283584:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.735274:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 74 00000100:00100000:1.0:1783349901.736230:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.736273:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283712 00000100:00100000:0.0:1783349901.736279:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283712 00000100:00100000:0.0:1783349901.736312:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:0.0:1783349901.736322:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+7:13675:x1869977655283712:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783349901.736574:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13675:x1869977655283712:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 253us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.736582:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 75 00000100:00100000:0.0:1783349901.737606:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349901.737660:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283840 00000100:00100000:1.0:1783349901.737667:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283840 00000100:00100000:1.0:1783349901.737705:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:1.0:1783349901.737713:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13675:x1869977655283840:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783349901.738197:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13675:x1869977655283840:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 483us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.738206:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 76 00000100:00100000:2.0:1783349901.740279:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.740341:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655283968 00000100:00100000:0.0:1783349901.740349:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655283968 00000100:00100000:0.0:1783349901.740532:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:0.0:1783349901.740553:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13694:x1869977655283968:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783349901.741036:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13694:x1869977655283968:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 485us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.741042:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 77 00000100:00100000:3.0:1783349901.762404:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349901.762499:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284096 00000100:00100000:1.0:1783349901.762520:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284096 00000100:00100000:1.0:1783349901.762577:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:1.0:1783349901.762588:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13694:x1869977655284096:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349901.762904:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13694:x1869977655284096:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 316us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.762913:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 78 00000100:00100000:1.0:1783349901.767195:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.767259:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284224 00000100:00100000:0.0:1783349901.767269:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284224 00000100:00100000:0.0:1783349901.767322:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:0.0:1783349901.767332:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+8:13675:x1869977655284224:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783349901.767349:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349901.767369:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fb4a7000/0x68b4a22a484775f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd87 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.767395:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a7000/0x68b4a22a484775f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd87 expref: 9 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.767406:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fb4a7000/0x68b4a22a484775f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd87 expref: 9 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349901.767415:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7000, rc 0) 00000100:00100000:0.0:1783349901.767463:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+9:13675:x1869977655284224:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 132us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349901.767470:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 79 00000100:00100000:2.0:1783349901.777110:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349901.777990:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284352 00000100:00100000:1.0:1783349901.778003:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284352 00000100:00100000:1.0:1783349901.778065:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:1.0:1783349901.778074:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+9:13675:x1869977655284352:12345-192.168.204.36@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783349901.778107:0:14132:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783349901.778130:0:14132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783349901.778135:0:14132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783349901.778139:0:14132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783349901.778141:0:14132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1783349901.783526:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+9:13675:x1869977655284352:12345-192.168.204.36@tcp:256:mount.lustre.0 Request processed in 5442us (6414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.783538:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 80 00000100:00100000:0.0:1783349901.787454:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.787521:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284480 00000100:00100000:2.0:1783349901.787531:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284480 00000100:00100000:2.0:1783349901.787634:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:2.0:1783349901.787645:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+9:13675:x1869977655284480:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783349901.787662:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349901.787692:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bd8e expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.787721:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 10 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.787733:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 10 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349901.787755:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003200, rc 0) 00000100:00100000:2.0:1783349901.787871:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13675:x1869977655284480:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.787878:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 81 00000100:00100000:2.0:1783349901.790064:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349901.790221:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284608 00000100:00100000:1.0:1783349901.790229:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284608 00000100:00100000:1.0:1783349901.790315:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:1.0:1783349901.790324:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13675:x1869977655284608:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783349901.790606:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13675:x1869977655284608:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 282us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.790613:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 82 00000100:00100000:1.0:1783349901.792580:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.793962:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284736 00000100:00100000:2.0:1783349901.793973:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284736 00000100:00100000:2.0:1783349901.794021:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:2.0:1783349901.794030:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13675:x1869977655284736:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783349901.794276:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13675:x1869977655284736:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 247us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.794282:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 83 00000100:00100000:0.0:1783349901.799250:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349901.799318:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284864 00000100:00100000:1.0:1783349901.799328:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284864 00000100:00100000:1.0:1783349901.799388:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:1.0:1783349901.799398:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13699:x1869977655284864:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349901.799656:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13699:x1869977655284864:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 259us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.799664:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 84 00000100:00100000:0.0:1783349901.802591:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349901.802654:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655284992 00000100:00100000:3.0:1783349901.802665:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655284992 00000100:00100000:3.0:1783349901.803097:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:3.0:1783349901.803108:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13699:x1869977655284992:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783349901.803368:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13699:x1869977655284992:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 262us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.803376:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 85 00000100:00100000:3.0:1783349901.806455:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.806554:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285120 00000100:00100000:0.0:1783349901.806574:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285120 00000100:00100000:0.0:1783349901.806767:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:0.0:1783349901.806775:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1869977655285120:12345-192.168.204.36@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783349901.806828:0:14140:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e57dc1c2-2520-4aea-8a67-c57c01297213@192.168.204.36@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1783349901.806906:0:14140:0:(genops.c:1406:class_connect()) connect: client e57dc1c2-2520-4aea-8a67-c57c01297213, cookie 0x68b4a22a48477607 00000004:00100000:0.0:1783349901.806936:0:14140:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1783349901.806942:0:14140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1783349901.861593:0:14140:0:(import.c:65:import_set_state_nolock()) ffff9320fb15c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783349901.861669:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2358:x1869977655285120:12345-192.168.204.36@tcp:38:mount.lustre.0 Request processed in 54894us (55222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349901.861678:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:0.0:1783349901.870599:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349901.870667:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349901.870854:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285248 00000100:00100000:3.0:1783349901.870863:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285248 00000100:00100000:3.0:1783349901.870963:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285376 00000100:00100000:3.0:1783349901.870967:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285376 00000100:00100000:3.0:1783349901.871003:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349901.871011:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+7:0:x1869977655285248:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783349901.871053:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783349901.871137:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+7:0:x1869977655285248:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 126us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.871144:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349901.871162:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:3.0:1783349901.871169:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13675:x1869977655285376:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783349901.871180:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783349901.871203:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13675:x1869977655285376:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 35us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.871209:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00080000:0.0:1783349901.871568:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349901.873351:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.874540:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285504 00000100:00100000:2.0:1783349901.874552:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285504 00000100:00100000:2.0:1783349901.874605:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:2.0:1783349901.874614:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13675:x1869977655285504:12345-192.168.204.36@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783349901.876034:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13675:x1869977655285504:12345-192.168.204.36@tcp:40:mount.lustre.0 Request processed in 1415us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.876045:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:3.0:1783349901.879074:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.879326:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285632 00000100:00100000:2.0:1783349901.879337:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285632 00000100:00100000:2.0:1783349901.879381:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:2.0:1783349901.879387:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1869977655285632:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783349901.879413:0:14775:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e57dc1c2-2520-4aea-8a67-c57c01297213@192.168.204.36@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1783349901.879447:0:14775:0:(genops.c:1406:class_connect()) connect: client e57dc1c2-2520-4aea-8a67-c57c01297213, cookie 0x68b4a22a4847760e 00002000:00100000:2.0:1783349901.879456:0:14775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e57dc1c2-2520-4aea-8a67-c57c01297213/ffff9320f77df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783349901.879465:0:14775:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783349901.879705:0:14775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783349901.879730:0:14775:0:(import.c:65:import_set_state_nolock()) ffff9320f77da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349901.880137:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2358:x1869977655285632:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 739us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.880147:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:1.0:1783349901.881271:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.882054:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285760 00000100:00100000:2.0:1783349901.882063:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285760 00000100:00100000:2.0:1783349901.882111:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:2.0:1783349901.882118:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1869977655285760:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783349901.882156:0:14776:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e57dc1c2-2520-4aea-8a67-c57c01297213@192.168.204.36@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1783349901.882191:0:14776:0:(genops.c:1406:class_connect()) connect: client e57dc1c2-2520-4aea-8a67-c57c01297213, cookie 0x68b4a22a48477615 00002000:00100000:2.0:1783349901.882203:0:14776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e57dc1c2-2520-4aea-8a67-c57c01297213/ffff9320f77dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783349901.882213:0:14776:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783349901.882383:0:14776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783349901.882409:0:14776:0:(import.c:65:import_set_state_nolock()) ffff9320f77db000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783349901.882458:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2358:x1869977655285760:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 339us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349901.882466:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:1.0:1783349901.884472:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349901.884638:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655285888 00000100:00100000:2.0:1783349901.884647:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655285888 00000100:00100000:2.0:1783349901.884933:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:2.0:1783349901.884943:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13675:x1869977655285888:12345-192.168.204.36@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783349901.891281:0:14142:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6249us 00000004:00200000:3.0:1783349901.904629:0:14142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783349901.904822:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13675:x1869977655285888:12345-192.168.204.36@tcp:33:mount.lustre.0 Request processed in 19842us (20317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349901.904837:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:1.0:1783349902.278660:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349902.279011:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286016 00000100:00100000:0.0:1783349902.279027:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286016 00000100:00100000:0.0:1783349902.279123:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:0.0:1783349902.279136:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13720:x1869977655286016:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:0.0:1783349902.279165:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349902.279200:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847761c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bdb8 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.279297:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48477623 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.279313:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48477623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.279331:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48477623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349902.279549:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783349902.279560:0:14139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349902.279667:0:14139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48477623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.279696:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6a00/0x68b4a22a4847761c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdb8 expref: 8 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.279732:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48477623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdb8 expref: 7 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349902.279741:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:0.0:1783349902.279745:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349902.279748:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6000, rc 0) 00000100:00100000:0.0:1783349902.279880:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+7:13720:x1869977655286016:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 747us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349902.279888:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00010000:00010000:1.0:1783349902.634125:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783349902.827251:0:14173:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783349902.827261:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783349902.828197:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1783349902.828205:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1783349903.257376:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e57dc1c2-2520-4aea-8a67-c57c01297213 00010000:00010000:3.0:1783349903.658779:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349904.296700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349904.297081:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286144 00000100:00100000:3.0:1783349904.297099:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286144 00000100:00100000:3.0:1783349904.297211:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:3.0:1783349904.297244:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+7:13773:x1869977655286144:12345-192.168.204.36@tcp:41:lfs.0 00000004:00000024:3.0:1783349904.297309:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783349904.297432:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+7:13773:x1869977655286144:12345-192.168.204.36@tcp:41:lfs.0 Request processed in 191us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349904.297440:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00080000:0.0:1783349904.297613:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783349904.305510:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.305888:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286272 00000100:00100000:2.0:1783349904.305903:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286272 00000100:00100000:2.0:1783349904.306004:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:2.0:1783349904.306017:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e57dc1c2-2520-4aea-8a67-c57c01297213+5:13773:x1869977655286272:12345-192.168.204.36@tcp:13:lfs.0 00002000:00000024:2.0:1783349904.306075:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349904.306194:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e57dc1c2-2520-4aea-8a67-c57c01297213+5:13773:x1869977655286272:12345-192.168.204.36@tcp:13:lfs.0 Request processed in 179us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.306203:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00080000:0.0:1783349904.307088:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349904.311138:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.311875:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286400 00000100:00100000:2.0:1783349904.311895:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286400 00000100:00100000:2.0:1783349904.312017:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:2.0:1783349904.312032:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13773:x1869977655286400:12345-192.168.204.36@tcp:13:lfs.0 00002000:00000024:2.0:1783349904.312094:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349904.312234:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e57dc1c2-2520-4aea-8a67-c57c01297213+6:13773:x1869977655286400:12345-192.168.204.36@tcp:13:lfs.0 Request processed in 205us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.312243:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00080000:0.0:1783349904.312787:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349904.555256:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349904.555507:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286528 00000100:00100000:1.0:1783349904.555521:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286528 00000100:00100000:1.0:1783349904.555613:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:1.0:1783349904.555626:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+10:13805:x1869977655286528:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783349904.555650:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349904.555674:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb000/0x68b4a22a4847762a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bdbf expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.555711:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb000/0x68b4a22a4847762a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdbf expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.555916:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb000/0x68b4a22a4847762a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdbf expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349904.555927:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb000, rc 0) 00000100:00100000:1.0:1783349904.556120:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13805:x1869977655286528:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 495us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.556129:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 86 00000100:00100000:3.0:1783349904.563423:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.563585:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286656 00000100:00100000:2.0:1783349904.563600:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286656 00000100:00100000:2.0:1783349904.563683:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:2.0:1783349904.563695:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13805:x1869977655286656:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783349904.566708:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13805:x1869977655286656:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 2995us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.566727:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 87 00000100:00100000:0.0:1783349904.589321:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.590480:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286784 00000100:00100000:2.0:1783349904.590549:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286784 00000100:00100000:2.0:1783349904.590645:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 88 00000100:00100000:2.0:1783349904.590659:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13805:x1869977655286784:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783349904.591397:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13805:x1869977655286784:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 736us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.591408:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 88 00000100:00100000:3.0:1783349904.617432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.618857:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655286912 00000100:00100000:2.0:1783349904.618875:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655286912 00000100:00100000:2.0:1783349904.618974:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:2.0:1783349904.618987:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13812:x1869977655286912:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783349904.619457:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13812:x1869977655286912:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 471us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.619467:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 89 00000100:00100000:3.0:1783349904.645433:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349904.646657:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287040 00000100:00100000:1.0:1783349904.646675:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287040 00000100:00100000:1.0:1783349904.646767:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:1.0:1783349904.646779:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13812:x1869977655287040:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783349904.647226:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13812:x1869977655287040:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 446us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.647237:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 90 00000100:00100000:1.0:1783349904.657707:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.657870:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287168 00000100:00100000:0.0:1783349904.657883:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287168 00000100:00100000:0.0:1783349904.657958:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:0.0:1783349904.657969:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13805:x1869977655287168:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783349904.657994:0:14134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349904.658018:0:14134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320fb4a7e00/0x68b4a22a48477631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bde9 expref: -99 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349904.658079:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fb4a7e00/0x68b4a22a48477631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bde9 expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349904.658093:0:14134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320fb4a7e00/0x68b4a22a48477631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bde9 expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349904.658104:0:14134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7e00, rc 0) 00000100:00100000:0.0:1783349904.658184:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13805:x1869977655287168:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 216us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349904.658192:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 91 00000100:00100000:3.0:1783349904.661155:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.661287:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287296 00000100:00100000:2.0:1783349904.661303:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287296 00000100:00100000:2.0:1783349904.661391:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:2.0:1783349904.661401:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13805:x1869977655287296:12345-192.168.204.36@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783349904.661435:0:14133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783349904.661465:0:14133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783349904.661469:0:14133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783349904.661473:0:14133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783349904.661476:0:14133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783349904.663704:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13805:x1869977655287296:12345-192.168.204.36@tcp:256:mount.lustre.0 Request processed in 2290us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.663719:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 92 00000100:00100000:1.0:1783349904.665976:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.666146:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287424 00000100:00100000:2.0:1783349904.666174:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287424 00000100:00100000:2.0:1783349904.666234:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:2.0:1783349904.666244:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13805:x1869977655287424:12345-192.168.204.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783349904.666262:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349904.666284:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bdf0 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349904.666319:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349904.666331:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349904.666342:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002c00, rc 0) 00000100:00100000:2.0:1783349904.666404:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13805:x1869977655287424:12345-192.168.204.36@tcp:101:mount.lustre.0 Request processed in 162us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.666411:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 93 00000100:00100000:3.0:1783349904.668521:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.668726:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287552 00000100:00100000:2.0:1783349904.668746:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287552 00000100:00100000:2.0:1783349904.668855:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:2.0:1783349904.668866:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13805:x1869977655287552:12345-192.168.204.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783349904.669248:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13805:x1869977655287552:12345-192.168.204.36@tcp:501:mount.lustre.0 Request processed in 382us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.669257:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 94 00000100:00100000:3.0:1783349904.672632:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.672856:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287680 00000100:00100000:0.0:1783349904.672871:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287680 00000100:00100000:0.0:1783349904.672961:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:0.0:1783349904.672973:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13805:x1869977655287680:12345-192.168.204.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783349904.673366:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13805:x1869977655287680:12345-192.168.204.36@tcp:503:mount.lustre.0 Request processed in 393us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349904.673385:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 95 00000100:00100000:0.0:1783349904.680706:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.680860:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287808 00000100:00100000:2.0:1783349904.680876:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287808 00000100:00100000:2.0:1783349904.680976:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 96 00000100:00100000:2.0:1783349904.680989:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13815:x1869977655287808:12345-192.168.204.36@tcp:502:llog_process_th.0 00010000:00010000:3.0:1783349904.682200:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349904.682721:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13815:x1869977655287808:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 1724us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.682735:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 96 00000100:00100000:3.0:1783349904.697903:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349904.698202:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655287936 00000100:00100000:2.0:1783349904.698215:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655287936 00000100:00100000:2.0:1783349904.698290:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 97 00000100:00100000:2.0:1783349904.698302:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13815:x1869977655287936:12345-192.168.204.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783349904.698641:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13815:x1869977655287936:12345-192.168.204.36@tcp:502:llog_process_th.0 Request processed in 340us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349904.698651:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 97 00000100:00100000:3.0:1783349904.715071:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.724478:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288064 00000100:00100000:0.0:1783349904.724511:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288064 00000100:00100000:0.0:1783349904.724619:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:0.0:1783349904.724632:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1869977655288064:12345-192.168.204.36@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783349904.724692:0:14139:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d8a5277a-b365-42d1-8539-cd0a1e990d5e@192.168.204.36@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:0.0:1783349904.725022:0:14139:0:(genops.c:1406:class_connect()) connect: client d8a5277a-b365-42d1-8539-cd0a1e990d5e, cookie 0x68b4a22a4847763f 00000004:00100000:0.0:1783349904.725083:0:14139:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783349904.726510:0:14139:0:(import.c:65:import_set_state_nolock()) ffff9320fb493800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783349904.726657:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2358:x1869977655288064:12345-192.168.204.36@tcp:38:mount.lustre.0 Request processed in 2020us (11595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349904.726671:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:1.0:1783349904.740382:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.740697:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288192 00000100:00100000:0.0:1783349904.740711:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288192 00000100:00100000:0.0:1783349904.740832:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349904.740846:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:0:x1869977655288192:12345-192.168.204.36@tcp:41:mount.lustre.0 00000100:00080000:1.0:1783349904.741122:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1783349904.741150:0:14798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783349904.741258:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:0:x1869977655288192:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 415us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349904.741267:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349904.748333:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349904.748482:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288320 00000100:00100000:1.0:1783349904.748497:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288320 00000100:00100000:1.0:1783349904.748578:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:1.0:1783349904.748590:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13805:x1869977655288320:12345-192.168.204.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783349904.748635:0:14139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783349904.748742:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13805:x1869977655288320:12345-192.168.204.36@tcp:41:mount.lustre.0 Request processed in 154us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.748772:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:2.0:1783349904.751975:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.752115:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288448 00000100:00100000:0.0:1783349904.752131:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288448 00000100:00100000:0.0:1783349904.752215:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:0.0:1783349904.752228:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13805:x1869977655288448:12345-192.168.204.36@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783349904.752422:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13805:x1869977655288448:12345-192.168.204.36@tcp:40:mount.lustre.0 Request processed in 196us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349904.752431:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:0.0:1783349904.756401:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.756448:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349904.756482:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349904.756565:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288576 00000100:00100000:3.0:1783349904.756578:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288576 00000100:00100000:3.0:1783349904.756632:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288704 00000100:00100000:3.0:1783349904.756636:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288704 00000100:00100000:3.0:1783349904.756655:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:3.0:1783349904.756665:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1869977655288576:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783349904.756704:0:14776:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d8a5277a-b365-42d1-8539-cd0a1e990d5e@192.168.204.36@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:3.0:1783349904.756753:0:14776:0:(genops.c:1406:class_connect()) connect: client d8a5277a-b365-42d1-8539-cd0a1e990d5e, cookie 0x68b4a22a48477646 00002000:00100000:3.0:1783349904.756768:0:14776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8a5277a-b365-42d1-8539-cd0a1e990d5e/ffff9320fb14b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783349904.756782:0:14776:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783349904.757005:0:14776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783349904.757058:0:14776:0:(import.c:65:import_set_state_nolock()) ffff9320fb14d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349904.757143:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2358:x1869977655288576:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 478us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349904.757151:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:3.0:1783349904.757171:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:3.0:1783349904.757175:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1869977655288704:12345-192.168.204.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783349904.757192:0:14776:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d8a5277a-b365-42d1-8539-cd0a1e990d5e@192.168.204.36@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:3.0:1783349904.757210:0:14776:0:(genops.c:1406:class_connect()) connect: client d8a5277a-b365-42d1-8539-cd0a1e990d5e, cookie 0x68b4a22a4847764d 00002000:00100000:3.0:1783349904.757215:0:14776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8a5277a-b365-42d1-8539-cd0a1e990d5e/ffff9320fb14c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783349904.757223:0:14776:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783349904.757286:0:14776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783349904.757304:0:14776:0:(import.c:65:import_set_state_nolock()) ffff9320fb148800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783349904.757328:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2358:x1869977655288704:12345-192.168.204.36@tcp:8:mount.lustre.0 Request processed in 151us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349904.757335:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:1.0:1783349904.758075:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288832 00000100:00100000:1.0:1783349904.758087:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288832 00000100:00100000:1.0:1783349904.758136:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:1.0:1783349904.758145:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320e40ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13805:x1869977655288832:12345-192.168.204.36@tcp:33:mount.lustre.0 00000004:00200000:1.0:1783349904.758423:0:14143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783349904.758569:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320e40ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13805:x1869977655288832:12345-192.168.204.36@tcp:33:mount.lustre.0 Request processed in 425us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349904.758577:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:0.0:1783349905.011394:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349905.011509:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655288960 00000100:00100000:1.0:1783349905.011523:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655288960 00000100:00100000:1.0:1783349905.011603:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:1.0:1783349905.011613:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:13836:x1869977655288960:12345-192.168.204.36@tcp:101:mkdir.0 00010000:00010000:1.0:1783349905.011655:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349905.011952:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be1a expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.012044:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.012060:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.012078:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349905.012500:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783349905.012512:0:14139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349905.012602:0:14139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.015195:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a48477654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 8 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.015248:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 7 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349905.015258:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:1.0:1783349905.015261:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349905.015266:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacae00, rc 0) 00000100:00100000:1.0:1783349905.015385:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+7:13836:x1869977655288960:12345-192.168.204.36@tcp:101:mkdir.0 Request processed in 3771us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349905.015396:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00010000:00010000:3.0:1783349905.707666:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349906.282950:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666802560:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283088:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.283164:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666803072:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283196:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.283228:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349906.283234:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666802688:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283264:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.283343:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802560 00000100:00100000:3.0:1783349906.283352:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802560 00000100:00100000:3.0:1783349906.283436:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802688 00000100:00100000:3.0:1783349906.283440:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802688 00000100:00100000:3.0:1783349906.283464:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349906.283474:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666802560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283539:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666802560:12345-0@lo:400:kworker.0 Request processed in 66us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.283549:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783349906.283569:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349906.283576:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666802688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283621:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1869977666802688:12345-0@lo:400:kworker.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.283627:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783349906.283645:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666803200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349906.283678:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.283731:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666802688:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283742:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666802560:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283858:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666802816:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.283912:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783349906.283919:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff931fc5904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666802432:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283949:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.283972:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666802944:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.283993:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.284025:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803072 00000100:00100000:3.0:1783349906.284030:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803072 00000100:00100000:3.0:1783349906.284065:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802816 00000100:00100000:3.0:1783349906.284068:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802816 00000100:00100000:3.0:1783349906.284078:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802944 00000100:00100000:3.0:1783349906.284081:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802944 00000100:00100000:3.0:1783349906.284094:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349906.284100:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666803072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284135:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666803072:12345-0@lo:400:kworker.0 Request processed in 35us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.284142:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349906.284154:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349906.284160:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666802816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284193:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1869977666802816:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.284200:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349906.284213:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349906.284220:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666802944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284246:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666802944:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.284252:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783349906.284276:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666803072:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284298:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666802944:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284308:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1869977666802816:0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284338:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666802432 00000100:00100000:3.0:1783349906.284341:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666802432 00000100:00100000:3.0:1783349906.284367:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783349906.284373:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3293:x1869977666802432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349906.284422:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3293:x1869977666802432:12345-0@lo:400:kworker.0 Request processed in 48us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.284429:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783349906.284462:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803200 00000100:00100000:3.0:1783349906.284466:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803200 00000100:00100000:3.0:1783349906.284488:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349906.284493:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666803200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349906.284530:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349906.284571:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666803200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349906.284578:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349906.284611:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666803200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349906.284634:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff931fc5904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666802432:0@lo:400:kworker.0 00000100:00080000:1.0:1783349906.285113:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349906.285122:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783349906.285124:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349906.315069:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783349906.315123:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666803328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349906.315269:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349906.315358:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803328 00000100:00100000:3.0:1783349906.315369:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803328 00000100:00100000:3.0:1783349906.315445:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349906.315456:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666803328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349906.315518:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349906.315584:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1869977666803328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349906.316137:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb559c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1869977666803328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349906.320820:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00100000:2.0:1783349906.472585:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783349906.472621:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e57dc1c2-2520-4aea-8a67-c57c01297213 00000001:00080000:2.0:1783349906.472638:0:7491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1783349906.472969:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8a5277a-b365-42d1-8539-cd0a1e990d5e 00010000:00010000:2.0:1783349906.732786:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783349907.423555:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8a5277a-b365-42d1-8539-cd0a1e990d5e 00000001:00100000:2.0:1783349907.424280:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e57dc1c2-2520-4aea-8a67-c57c01297213 00010000:00010000:3.0:1783349907.760183:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783349908.637146:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8a5277a-b365-42d1-8539-cd0a1e990d5e 00010000:00010000:2.0:1783349908.780843:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783349909.802984:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783349910.168438:0:16000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1783349910.204202:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349910.204259:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349910.204314:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349910.204357:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349910.204381:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349910.204404:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349910.204448:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349910.204476:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289344 00000100:00100000:0.0:1783349910.204480:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289856 00000100:00100000:0.0:1783349910.204499:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289856 00000100:00100000:3.0:1783349910.204500:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289344 00000100:00100000:1.0:1783349910.204585:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289600 00000100:00100000:1.0:1783349910.204592:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289600 00000100:00100000:0.0:1783349910.204656:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289472 00000100:00100000:0.0:1783349910.204660:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289472 00000100:00100000:2.0:1783349910.204730:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289088 00000100:00100000:2.0:1783349910.204735:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289088 00000100:00100000:2.0:1783349910.204773:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:2.0:1783349910.204785:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2360:x1869977655289088:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.204918:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2360:x1869977655289088:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 134us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.204927:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 99 00000100:00100000:2.0:1783349910.205196:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289216 00000100:00100000:2.0:1783349910.205200:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289216 00000100:00100000:3.0:1783349910.206196:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289728 00000100:00100000:3.0:1783349910.206205:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289728 00000100:00100000:3.0:1783349910.206229:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:3.0:1783349910.206238:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655289856:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349910.206330:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655289856:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 93us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349910.206338:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:3.0:1783349910.206355:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:3.0:1783349910.206361:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655289344:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349910.206382:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655289344:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 21us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349910.206387:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:3.0:1783349910.207503:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349910.207515:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655289728:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349910.207550:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655289728:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 40us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349910.207557:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:1.0:1783349910.207997:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:1.0:1783349910.208013:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2360:x1869977655289600:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349910.208092:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2360:x1869977655289600:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 83us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349910.208100:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00080000:1.0:1783349910.208147:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349910.208154:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783349910.208157:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783349910.213279:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:3.0:1783349910.213310:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655289472:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349910.213509:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655289472:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 216us (9101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349910.213525:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:2.0:1783349910.214411:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:2.0:1783349910.214426:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2360:x1869977655289216:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349910.214500:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2360:x1869977655289216:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 78us (10117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349910.214509:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00010000:00010000:2.0:1783349910.826166:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349911.404650:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666803456:0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.405277:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349911.405335:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666803968:0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.405363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349911.405391:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783349911.405398:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666803840:0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.405421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349911.405461:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803456 00000100:00100000:2.0:1783349911.405470:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803456 00000100:00100000:2.0:1783349911.405520:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783349911.405529:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666803456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.405586:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666803456:12345-0@lo:400:kworker.0 Request processed in 58us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349911.405595:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783349911.405677:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803968 00000100:00100000:2.0:1783349911.405681:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803968 00000100:00100000:2.0:1783349911.405716:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803840 00000100:00100000:2.0:1783349911.405718:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803840 00000100:00100000:2.0:1783349911.405734:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349911.405740:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666803968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349911.405998:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349911.406020:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666803840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349911.406056:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666803840:12345-0@lo:400:kworker.0 Request processed in 51us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349911.406063:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783349911.406108:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666803840:0@lo:400:kworker.0 00000100:00100000:1.0:1783349911.406118:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666803456:0@lo:400:kworker.0 00000100:00080000:1.0:1783349911.406153:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349911.408955:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1869977666803968:12345-0@lo:400:kworker.0 Request processed in 3199us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349911.408975:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783349911.409170:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666803584:0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.409245:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349911.409275:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666804096:0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.409298:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349911.409320:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783349911.409325:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666803712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.409343:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349911.409706:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666804096 00000100:00100000:2.0:1783349911.409717:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666804096 00000100:00100000:2.0:1783349911.409824:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783349911.409834:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.409907:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666804096:12345-0@lo:400:kworker.0 Request processed in 75us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349911.409914:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783349911.409945:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349911.409995:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666804096:0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.410775:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1869977666803968:0@lo:400:kworker.0 00000100:00100000:2.0:1783349911.410869:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349911.410882:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666804224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349911.410885:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803584 00000100:00100000:3.0:1783349911.410892:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803584 00000100:00100000:2.0:1783349911.410929:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349911.410938:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666803712 00000100:00100000:3.0:1783349911.410941:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666803712 00000100:00100000:3.0:1783349911.410959:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783349911.410966:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666803584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.411016:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666803584:12345-0@lo:400:kworker.0 Request processed in 50us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349911.411024:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783349911.411024:0:14776:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783349911.411033:0:14776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783349911.411037:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349911.411043:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666803712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.411072:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666803712:12345-0@lo:400:kworker.0 Request processed in 30us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349911.411077:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783349911.411097:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349911.411101:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349911.411113:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666804224 00000100:00100000:3.0:1783349911.411116:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666804224 00000100:00100000:3.0:1783349911.411136:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349911.411141:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666804224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783349911.411183:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783349911.411190:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666804352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783349911.411216:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666804224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349911.411216:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349911.411223:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783349911.411233:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666804352 00000100:00100000:3.0:1783349911.411236:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666804352 00000100:00100000:3.0:1783349911.411249:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349911.411254:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666804352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783349911.411274:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783349911.411305:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666804352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349911.411312:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783349911.411333:0:3291:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1783349911.411352:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666804224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783349911.411362:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666803712:0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.411371:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666803584:0@lo:400:kworker.0 00000100:00100000:3.0:1783349911.411408:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666804352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783349911.853584:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783349912.170774:0:14173:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783349912.170789:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349912.171371:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1783349912.171463:0:14173:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349912.171509:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1783349912.875028:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349913.898024:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349915.228034:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.228075:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.228099:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.228119:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.228133:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349915.228232:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290112 00000100:00100000:2.0:1783349915.228254:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290112 00000100:00100000:2.0:1783349915.228304:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349915.228313:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2360:x1869977655290112:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349915.228439:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2360:x1869977655290112:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 127us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349915.228447:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349915.228488:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655289984 00000100:00100000:2.0:1783349915.228492:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655289984 00000100:00100000:2.0:1783349915.228515:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 101 00000100:00100000:2.0:1783349915.228522:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2360:x1869977655289984:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349915.228548:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2360:x1869977655289984:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.228731:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.228821:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.228900:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290368 00000100:00100000:3.0:1783349915.228904:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290368 00000100:00100000:3.0:1783349915.228923:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290624 00000100:00100000:3.0:1783349915.228925:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290624 00000100:00100000:3.0:1783349915.228934:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290240 00000100:00100000:3.0:1783349915.228936:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290240 00000100:00100000:3.0:1783349915.228944:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290752 00000100:00100000:3.0:1783349915.228946:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290752 00000100:00100000:3.0:1783349915.228958:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:3.0:1783349915.228963:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc5904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655290368:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349915.228991:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc5904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655290368:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.228997:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:3.0:1783349915.229008:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:3.0:1783349915.229013:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655290624:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349915.229029:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655290624:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 17us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.229034:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:3.0:1783349915.229042:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:3.0:1783349915.229046:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655290240:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349915.229075:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2360:x1869977655290240:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 27us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.229080:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:3.0:1783349915.229090:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:3.0:1783349915.229094:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655290752:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349915.229109:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2360:x1869977655290752:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 15us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.229120:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00080000:3.0:1783349915.229133:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783349915.229136:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783349915.229139:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349915.229146:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290496 00000100:00100000:3.0:1783349915.229158:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290496 00000100:00100000:3.0:1783349915.229183:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:3.0:1783349915.229187:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2360:x1869977655290496:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349915.229209:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2360:x1869977655290496:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 22us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.229214:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00080000:3.0:1783349915.229268:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349915.229343:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 101 00010000:00010000:3.0:1783349915.442542:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783349915.626914:0:16150:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe529b6be0 20000000:00000080:2.0:1783349915.626935:0:16150:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff931fc4eb8c00 uarg=0000000000000000 20000000:01000000:2.0:1783349915.626972:0:16150:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783349915.626978:0:16150:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783349915.626983:0:16150:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783349915.627532:0:16151:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1783349915.627682:0:16150:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783349915.635275:0:16150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783349915.635303:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635322:0:16150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847734b expref: 18 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635330:0:16150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a4847739f expref: 18 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635338:0:16150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635347:0:16150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635366:0:16150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635374:0:16150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635416:0:16150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.635431:0:16150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 12 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349915.635446:0:16150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804480:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349915.635788:0:16150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 12 pid: 14134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.636168:0:16150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 12 pid: 14134 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349915.636181:0:16150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec481880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804608:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349915.636246:0:16150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.636257:0:16150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 18 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349915.636268:0:16150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804736:0@lo:104: 00000100:00100000:3.0:1783349915.636312:0:16150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349915.636364:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666804736 00000100:00100000:3.0:1783349915.636372:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666804736 00000100:00100000:3.0:1783349915.636426:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783349915.636437:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+3:16150:x1869977666804736:12345-0@lo:104: 00010000:00010000:2.0:1783349915.637921:0:16150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a4847739f expref: 18 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.637934:0:16150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a4847739f expref: 18 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349915.637946:0:16150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804864:0@lo:104: 00000100:00100000:2.0:1783349915.637979:0:16150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783349915.638012:0:16150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x68b4a22a4847734b expref: 18 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.638030:0:16150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x68b4a22a4847734b expref: 18 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349915.638039:0:16150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804992:0@lo:104: 00000100:00100000:2.0:1783349915.638062:0:16150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349915.638071:0:16150:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e40709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783349915.638135:0:14123:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783349915.638146:0:14123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783349915.638151:0:14123:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1783349915.638390:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666804864 00000100:00100000:1.0:1783349915.638395:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666804864 00000100:00100000:1.0:1783349915.638422:0:14123:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1783349915.638427:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666804992 00000100:00100000:1.0:1783349915.638430:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666804992 00000100:00100000:0.0:1783349915.638543:0:16152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783349915.638551:0:16152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+5:16150:x1869977666804864:12345-0@lo:104: 00010000:00010000:3.0:1783349915.640243:0:14122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349915.640316:0:16152:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.640333:0:14122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783349915.640344:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+5:16150:x1869977666804736:12345-0@lo:104: Request processed in 3907us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.640354:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783349915.640366:0:16152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783349915.640373:0:16152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+4:16150:x1869977666804864:12345-0@lo:104: Request processed in 1823us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349915.640382:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783349915.640390:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c7477c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+4:16150:x1869977666804992:12345-0@lo:104: 00010000:00010000:3.0:1783349915.640399:0:14122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640416:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349915.640424:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349915.640431:0:14122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1783349915.640433:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca800 already unused, calling callback (ffffffffc1d04c20) 00000100:00100000:3.0:1783349915.640439:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c7477c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+4:16150:x1869977666804992:12345-0@lo:104: Request processed in 50us (2375us total) trans 0 rc 0/0 10000000:00010000:1.0:1783349915.640440:0:14128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640462:0:14128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349915.640468:0:14128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349915.640474:0:14128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783349915.640507:0:14128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640513:0:14128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349915.640531:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640537:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320faaca800/0x68b4a22a484774d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484774da expref: -99 pid: 15443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640548:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783349915.640551:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640556:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96000 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349915.640559:0:14128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640564:0:14128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349915.640570:0:14128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349915.640580:0:14128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783349915.640607:0:14128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.640613:0:14128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783349915.640652:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666805120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349915.640686:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349915.640738:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805120 00000100:00100000:2.0:1783349915.640745:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805120 00010000:00010000:2.0:1783349915.640765:0:14125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 19 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349915.640788:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783349915.640899:0:16152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349915.640940:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666805120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349915.640953:0:14125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349915.640958:0:14125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 19 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.640967:0:14125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 19 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.640983:0:14125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349915.641044:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641051:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fac96000/0x68b4a22a4847739f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a484773a6 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641061:0:14128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349915.641064:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641068:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6c00 already unused, calling callback (ffffffffc1d04c20) 10000000:00010000:1.0:1783349915.641071:0:14128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641076:0:14128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783349915.641083:0:14128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349915.641087:0:14128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783349915.641102:0:14128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641108:0:14128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783349915.641122:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641128:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.136@tcp lock: ffff9320fb4a6c00/0x68b4a22a4847734b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x68b4a22a48477352 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.641140:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349915.641142:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349915.641143:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349915.641182:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666805120:12345-0@lo:103:ldlm_bl.0 Request processed in 368us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349915.641189:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783349915.641233:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fb4a6200/0x68b4a22a484774da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a484774d3 expref: 18 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349915.641250:0:16150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804736:0@lo:104: 00000100:00100000:2.0:1783349915.641263:0:16150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804864:0@lo:104: 00000100:00100000:2.0:1783349915.641270:0:16150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804992:0@lo:104: 00000100:00100000:0.0:1783349915.641320:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666805120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349915.641735:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783349915.641772:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783349915.641785:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3291:1869977666805248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783349915.641920:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3292:1869977666805376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349915.641952:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349915.641989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349915.642065:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805248 00000100:00100000:2.0:1783349915.642069:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805248 00010000:00010000:2.0:1783349915.642085:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847739f expref: 18 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349915.642108:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805376 00000100:00100000:2.0:1783349915.642112:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805376 00010000:00010000:2.0:1783349915.642122:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847734b expref: 19 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349915.642134:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783349915.642140:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3291:x1869977666805248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349915.642149:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349915.642153:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847739f expref: 19 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.642162:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a4847739f expref: 19 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.642173:0:14126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320faacb800/0x68b4a22a484773a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a4847739f expref: 19 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.642182:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349915.642220:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:3291:x1869977666805248:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349915.642238:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783349915.642242:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3291:1869977666805248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783349915.642255:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783349915.642264:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c54d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:3292:x1869977666805376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783349915.642614:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349915.642620:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x68b4a22a4847734b expref: 17 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.642628:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x68b4a22a4847734b expref: 17 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.642638:0:14126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac97200/0x68b4a22a48477352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x68b4a22a4847734b expref: 17 pid: 14133 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.642647:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349915.642684:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c54d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:3292:x1869977666805376:12345-0@lo:103:ldlm_bl.0 Request processed in 422us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349915.642692:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783349915.642823:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3292:1869977666805376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783349915.644078:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349915.644099:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349915.644271:0:16150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804480:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349915.644281:0:16150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec481880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16150:1869977666804608:192.168.204.36@tcp:104: 00010000:00010000:2.0:1783349915.644305:0:16150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349915.644383:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655290880 00000100:00100000:1.0:1783349915.644389:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655290880 00010000:00010000:1.0:1783349915.644412:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 13 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349915.644468:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291008 00000100:00100000:1.0:1783349915.644471:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291008 00010000:00010000:1.0:1783349915.644485:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 14 pid: 14134 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349915.644499:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:1.0:1783349915.644506:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbe73cc-1856-47c4-9e27-5609d833c88a+14:2361:x1869977655290880:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349915.644516:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349915.644519:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 14 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644529:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 14 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644543:0:14126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9002c00/0x68b4a22a48477638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdf0 expref: 14 pid: 14132 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644570:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349915.644660:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2361:x1869977655290880:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 153us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349915.644668:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:1.0:1783349915.644684:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:1.0:1783349915.644691:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:2362:x1869977655291008:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349915.644698:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349915.644703:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 12 pid: 14134 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644712:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 12 pid: 14134 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644722:0:14126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320c9003200/0x68b4a22a48477600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bd8e expref: 12 pid: 14134 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644732:0:14126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644740:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644754:0:14126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644761:0:14126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644779:0:14126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644786:0:14126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644810:0:14126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97400 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349915.644871:0:14126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644879:0:14126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644892:0:14126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349915.644901:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349915.644921:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:2362:x1869977655291008:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 230us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349915.644928:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00010000:00010000:2.0:1783349915.645019:0:16150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.645027:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349915.645042:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9320fac97400/0x68b4a22a48477662 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349916.460675:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349916.522660:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666805504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349916.522743:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349916.522833:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805504 00000100:00100000:1.0:1783349916.522840:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805504 00000100:00100000:1.0:1783349916.522887:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783349916.522896:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666805504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783349916.522927:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349916.522965:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666805504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349916.522976:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783349916.523089:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349916.523452:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666805504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349916.523475:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666806016:0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.523503:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349916.523521:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783349916.523526:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666805632:0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.523549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349916.523830:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666805760:0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.523858:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349916.523875:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666806272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349916.523890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349916.523903:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783349916.523907:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666805888:0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.523922:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349916.523947:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805760 00000100:00100000:2.0:1783349916.523951:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805760 00000100:00100000:2.0:1783349916.524042:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349916.524053:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666805760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.524088:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666805760:12345-0@lo:400:kworker.0 Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349916.524094:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783349916.524236:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666806144:0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.524332:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806016 00000100:00100000:2.0:1783349916.524337:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806016 00000100:00100000:2.0:1783349916.524361:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805888 00000100:00100000:2.0:1783349916.524363:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805888 00000100:00100000:2.0:1783349916.524382:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349916.524388:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666806016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.524420:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1869977666806016:12345-0@lo:400:kworker.0 Request processed in 32us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349916.524426:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783349916.524446:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783349916.524452:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666805888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.524478:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666805888:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349916.524484:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783349916.524510:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666805888:0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.524520:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666805760:0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.524824:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349916.524853:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1869977666806016:0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.524875:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806144 00000100:00100000:1.0:1783349916.524878:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806144 00000100:00100000:1.0:1783349916.524901:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349916.524907:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666806144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.524941:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666806144:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349916.524947:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783349916.524963:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666805632 00000100:00100000:1.0:1783349916.524966:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666805632 00000100:00100000:1.0:1783349916.525594:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783349916.525603:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:3293:x1869977666805632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.525641:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:3293:x1869977666805632:12345-0@lo:400:kworker.0 Request processed in 40us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349916.525660:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1783349916.525692:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349916.525697:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783349916.525706:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806272 00000100:00100000:1.0:1783349916.525709:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806272 00000100:00100000:2.0:1783349916.526348:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783349916.526358:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666806272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783349916.526384:0:14778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349916.526678:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666805632:0@lo:400:kworker.0 00000100:00100000:1.0:1783349916.526691:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666806144:0@lo:400:kworker.0 00000100:00100000:2.0:1783349916.526899:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666806272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 542us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349916.526907:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783349916.527061:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666806272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349917.212904:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349917.212939:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291136 00000100:00100000:1.0:1783349917.212947:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291136 00000100:00100000:1.0:1783349917.212992:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1783349917.213001:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+11:13689:x1869977655291136:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.213017:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349917.213035:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb200/0x68b4a22a48477669 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be21 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.213063:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb200/0x68b4a22a48477669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be21 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.213073:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb200/0x68b4a22a48477669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be21 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.213081:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb200, rc 0) 00000100:00100000:1.0:1783349917.213131:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13689:x1869977655291136:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 131us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.213138:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 103 00000100:00100000:1.0:1783349917.215900:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349917.216026:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291264 00000100:00100000:2.0:1783349917.216035:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291264 00000100:00100000:2.0:1783349917.216084:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 104 00000100:00100000:2.0:1783349917.216094:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13689:x1869977655291264:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349917.216335:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13689:x1869977655291264:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 242us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349917.216342:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 104 00000100:00100000:2.0:1783349917.219576:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349917.219637:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291392 00000100:00100000:3.0:1783349917.219646:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291392 00000100:00100000:3.0:1783349917.219719:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 105 00000100:00100000:3.0:1783349917.219729:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13689:x1869977655291392:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783349917.219990:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13689:x1869977655291392:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 262us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349917.219998:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 105 00000100:00100000:2.0:1783349917.227309:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349917.227570:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291520 00000100:00100000:1.0:1783349917.227579:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291520 00000100:00100000:1.0:1783349917.227674:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:1.0:1783349917.227683:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+12:13689:x1869977655291520:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.227700:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349917.227716:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faacb600/0x68b4a22a48477670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be28 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.227744:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faacb600/0x68b4a22a48477670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be28 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.227756:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faacb600/0x68b4a22a48477670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be28 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.227765:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb600, rc 0) 00000100:00100000:1.0:1783349917.227975:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13689:x1869977655291520:12345-192.168.204.36@tcp:101:ll_cfg_requeue.0 Request processed in 293us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.227983:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 106 00000100:00100000:3.0:1783349917.229691:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349917.230354:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291648 00000100:00100000:2.0:1783349917.230362:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291648 00000100:00100000:1.0:1783349917.230577:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:1.0:1783349917.230588:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13689:x1869977655291648:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.231105:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13689:x1869977655291648:12345-192.168.204.36@tcp:501:ll_cfg_requeue.0 Request processed in 519us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.231114:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 107 00000100:00100000:3.0:1783349917.233130:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349917.233199:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291776 00000100:00100000:2.0:1783349917.233215:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291776 00000100:00100000:2.0:1783349917.233255:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 108 00000100:00100000:2.0:1783349917.233263:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13689:x1869977655291776:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349917.233609:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:13689:x1869977655291776:12345-192.168.204.36@tcp:503:ll_cfg_requeue.0 Request processed in 345us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349917.233617:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 108 00010000:00010000:3.0:1783349917.482945:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783349917.552541:0:14136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349917.552559:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff931fc10b4800 from 10 10000000:01000000:3.0:1783349917.552564:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349917.552611:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349917.552622:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349917.552632:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349917.552667:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349917.552737:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349917.552814:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349917.564773:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806400 00000100:00100000:1.0:1783349917.564788:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806400 00000100:00100000:1.0:1783349917.564983:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349917.564994:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+16:14136:x1869977666806400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.565021:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349917.565041:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faaca600/0x68b4a22a4847767e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477677 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.565069:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faaca600/0x68b4a22a4847767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477677 expref: 17 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.565082:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faaca600/0x68b4a22a4847767e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477677 expref: 17 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.565092:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca600, rc 0) 00000100:00100000:1.0:1783349917.565169:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:14136:x1869977666806400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (12430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.565176:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783349917.565317:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.565335:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847767e expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.565346:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847767e expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349917.565433:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.565469:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349917.566697:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349917.566720:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806528 00000100:00100000:1.0:1783349917.566726:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806528 00000100:00100000:1.0:1783349917.566763:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783349917.566770:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:14136:x1869977666806528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.567032:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:14136:x1869977666806528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.567040:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783349917.567076:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.567110:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.567147:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349917.567160:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349917.567171:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806656 00000100:00100000:1.0:1783349917.567174:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806656 00000100:00100000:1.0:1783349917.567195:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783349917.567202:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff931fc4de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:14136:x1869977666806656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.567326:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff931fc4de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:14136:x1869977666806656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.567333:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783349917.567369:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783349917.570295:0:16257:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783349917.570343:0:14136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783349917.570361:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349917.570871:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847767e expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.570885:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac96e00/0x68b4a22a48477677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847767e expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783349917.570896:0:14136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783349917.570906:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff931fc7b8e000 from 10 10000000:01000000:1.0:1783349917.570909:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783349917.570940:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.570950:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.570960:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349917.570983:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.571042:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349917.571075:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783349917.571095:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806784 00000100:00100000:1.0:1783349917.571101:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806784 00000100:00100000:1.0:1783349917.571137:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349917.571145:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320facb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+17:14136:x1869977666806784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.571158:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349917.571171:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faaca400/0x68b4a22a4847768c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477685 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.571193:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faaca400/0x68b4a22a4847768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477685 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.571204:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faaca400/0x68b4a22a4847768c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477685 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.571213:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca400, rc 0) 00000100:00100000:1.0:1783349917.571247:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320facb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666806784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.571259:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783349917.571305:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.571317:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847768c expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.571326:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847768c expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349917.571367:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.574680:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349917.574721:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c6853a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349917.574940:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666806912 00000100:00100000:0.0:1783349917.574960:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666806912 00000100:00100000:0.0:1783349917.575011:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783349917.575020:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666806912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349917.575267:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666806912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349917.575275:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783349917.575316:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666806912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783349917.575357:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320fb558380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349917.575394:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349917.575417:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320ec73aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783349917.575428:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666807040 00000100:00100000:0.0:1783349917.575431:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666807040 00000100:00100000:0.0:1783349917.575450:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783349917.575456:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d173b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666807040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783349917.575611:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d173b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666807040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349917.575618:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783349917.575757:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320fb558380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783349917.577903:0:16258:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783349917.588174:0:14136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783349917.588210:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783349917.588223:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847768c expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.588236:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320faacbe00/0x68b4a22a48477685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847768c expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783349917.588982:0:14136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783349917.588988:0:14136:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9320f7b31800 from 10 10000000:01000000:3.0:1783349917.588992:0:14136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783349917.589038:0:14136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349917.589063:0:14136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349917.589075:0:14136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349917.589101:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783349917.589170:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349917.589211:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070900 going to sleep for 11 seconds 00000100:00100000:1.0:1783349917.589361:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666807168 00000100:00100000:1.0:1783349917.589369:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666807168 00000100:00100000:1.0:1783349917.589439:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783349917.589450:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d173a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+18:14136:x1869977666807168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783349917.589465:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349917.589476:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9320faaca200/0x68b4a22a4847769a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x68b4a22a48477693 expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.589777:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9320faaca200/0x68b4a22a4847769a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x68b4a22a48477693 expref: 19 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.589813:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9320faaca200/0x68b4a22a4847769a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x68b4a22a48477693 expref: 19 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349917.589823:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca200, rc 0) 00000100:00100000:1.0:1783349917.589870:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d173a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666807168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 422us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.589877:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783349917.589963:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783349917.589976:0:14136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847769a expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349917.589985:0:14136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x68b4a22a4847769a expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349917.590036:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783349917.590061:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349917.590088:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c8602c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783349917.591957:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666807296 00000100:00100000:1.0:1783349917.591971:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666807296 00000100:00100000:1.0:1783349917.592026:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783349917.592035:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666807296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.592305:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666807296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349917.592313:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783349917.592356:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.593621:0:14136:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783349917.593690:0:14136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349917.593723:0:14136:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0de40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349917.593969:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666807424 00000100:00100000:2.0:1783349917.593977:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666807424 00000100:00100000:2.0:1783349917.594012:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783349917.594019:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666807424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783349917.594187:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:14136:x1869977666807424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349917.594194:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783349917.595629:0:14136:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:14136:1869977666807424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783349917.598355:0:16260:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783349917.598475:0:14136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783349917.598509:0:14136:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783349917.598521:0:14136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847769a expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349917.598532:0:14136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.136@tcp lock: ffff9320fac97a00/0x68b4a22a48477693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x68b4a22a4847769a expref: -99 pid: 14136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349918.506380:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349919.073369:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349919.073517:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655291904 00000100:00100000:3.0:1783349919.073542:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655291904 00000100:00100000:3.0:1783349919.073645:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:3.0:1783349919.073658:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+6:14346:x1869977655291904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783349919.073685:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349919.073713:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be2f expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.073837:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.073856:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.073874:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.073892:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.073918:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.073926:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074461:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484776b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074472:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484776b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074480:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484776b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349919.074588:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783349919.074593:0:14139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349919.074696:0:14139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484776b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074710:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074717:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074725:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074731:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349919.074736:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074752:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074767:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349919.074770:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349919.074776:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074784:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484776a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074831:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074839:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074845:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074851:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349919.074854:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074861:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074869:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9320cf8b3600) 00010000:00010000:3.0:1783349919.074872:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349919.074875:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074891:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484776af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074931:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be2f expref: 8 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074946:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97400/0x68b4a22a484776b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be2f expref: 7 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.074953:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9320cf8b3d00) 00010000:00010000:3.0:1783349919.074956:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783349919.074959:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97400, rc 0) 00000100:00100000:3.0:1783349919.075053:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+7:14346:x1869977655291904:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1398us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349919.075063:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00080000:1.0:1783349919.075662:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349919.081769:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349919.081979:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655292160 00000100:00100000:1.0:1783349919.082008:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655292160 00000100:00100000:1.0:1783349919.082090:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:1.0:1783349919.082102:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+7:14346:x1869977655292160:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349919.082130:0:14141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349919.082155:0:14141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484776bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be36 expref: -99 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.082254:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.082279:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.082293:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.082314:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.082322:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.082329:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083007:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a484776d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083020:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a484776d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083028:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a484776d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349919.083051:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783349919.083358:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083368:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083375:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083382:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349919.083387:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083395:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083410:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9320cf8b3d00) 00010000:00010000:1.0:1783349919.083414:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349919.083420:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083427:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a484776c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083442:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083449:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083466:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083472:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349919.083475:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083482:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083491:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9320e0103d00) 00010000:00010000:1.0:1783349919.083494:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349919.083497:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.083504:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a484776cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.085195:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a484776bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be36 expref: 10 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.085221:0:14141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacb800/0x68b4a22a484776d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be36 expref: 9 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.085230:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103400) 00010000:00010000:1.0:1783349919.085233:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349919.085236:0:14141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacb800, rc 0) 00000100:00100000:1.0:1783349919.085385:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14346:x1869977655292160:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 3273us (3619us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783349919.085406:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:0.0:1783349919.090020:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349919.090111:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655292288 00000100:00100000:3.0:1783349919.090123:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655292288 00000100:00100000:3.0:1783349919.090192:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:3.0:1783349919.090202:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14346:x1869977655292288:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783349919.090321:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14346:x1869977655292288:12345-192.168.204.36@tcp:59:lhsmtool_posix.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349919.090328:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:2.0:1783349919.136091:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349919.136368:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655292416 00000100:00100000:0.0:1783349919.136390:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655292416 00000100:00100000:0.0:1783349919.136476:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:0.0:1783349919.136488:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14352:x1869977655292416:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349919.136524:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349919.136551:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a484776e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be3d expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.136640:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.136657:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.136672:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.136688:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.136696:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.136703:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137051:0:14140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137070:0:14140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137077:0:14140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137084:0:14140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349919.137089:0:14140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137097:0:14140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137112:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:0.0:1783349919.137116:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349919.137122:0:14140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137129:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a484776e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137144:0:14140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137151:0:14140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137157:0:14140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137163:0:14140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349919.137173:0:14140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137180:0:14140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137188:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9320c2913e00) 00010000:00010000:0.0:1783349919.137191:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349919.137194:0:14140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137200:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484776ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137240:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a484776e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be3d expref: 10 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137251:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:0.0:1783349919.137254:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349919.137258:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a484776e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be3d expref: 10 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.137268:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6800, rc 0) 00000100:00100000:0.0:1783349919.137456:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14352:x1869977655292416:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 969us (1377us total) trans 0 rc 301/301 00000100:00100000:0.0:1783349919.137465:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:1.0:1783349919.141529:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349919.141781:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655292544 00000100:00100000:3.0:1783349919.141816:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655292544 00000100:00100000:3.0:1783349919.141880:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:3.0:1783349919.141907:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14352:x1869977655292544:12345-192.168.204.36@tcp:700:lfs.0 00000100:00100000:3.0:1783349919.142007:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14352:x1869977655292544:12345-192.168.204.36@tcp:700:lfs.0 Request processed in 102us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349919.142015:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:3.0:1783349919.144143:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349919.144224:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655292800 00000100:00100000:2.0:1783349919.144243:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655292800 00000100:00100000:2.0:1783349919.144293:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:2.0:1783349919.144301:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14352:x1869977655292800:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:2.0:1783349919.144360:0:14139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349919.144404:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6000/0x68b4a22a48477623 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bdb8 expref: 9 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.144424:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:2.0:1783349919.144429:0:14139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349919.144898:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.144914:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 5 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.144923:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.145139:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 5 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.145154:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 5 pid: 14139 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349919.145170:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14139:1869977666807552:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349919.145296:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0bf6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783349919.153842:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349919.155112:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655292928 00000100:00100000:1.0:1783349919.155126:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655292928 00010000:00010000:1.0:1783349919.155194:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 6 pid: 14139 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349919.155231:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:1.0:1783349919.155240:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2362:x1869977655292928:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783349919.155257:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349919.155264:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 6 pid: 14139 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.155277:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 6 pid: 14139 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.155302:0:14126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:1.0:1783349919.155309:0:14126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.155319:0:14126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.155327:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.155348:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349919.155414:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2362:x1869977655292928:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 174us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349919.155436:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00080000:2.0:1783349919.155649:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783349919.159934:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a4847765b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be1a expref: 5 pid: 14139 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349919.160018:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14139:1869977666807552:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349919.160046:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.160057:0:14139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.160063:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.160096:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.160109:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.160119:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349919.162737:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783349919.162757:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.162775:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.162783:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.162828:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349919.162835:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.162843:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.162862:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913700) 00010000:00010000:3.0:1783349919.162865:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349919.162870:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.162877:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a484776f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783349919.162899:0:14139:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecefe822 reply state 00000000b178d334 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349919.162908:0:14139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349919.163020:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14352:x1869977655292800:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 18714us (18877us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783349919.163030:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00010000:00010000:3.0:1783349919.173300:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.173339:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.173348:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.173354:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349919.173359:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.173368:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.173397:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9320cf8b3600) 00010000:00010000:3.0:1783349919.173400:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349919.173405:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.173411:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484776fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349919.277747:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349919.277963:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655293056 00000100:00100000:0.0:1783349919.277976:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655293056 00000100:00100000:0.0:1783349919.278050:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1783349919.278063:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+9:14360:x1869977655293056:12345-192.168.204.36@tcp:101:lctl.0 00010000:00010000:0.0:1783349919.278109:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349919.278138:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48477703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be44 expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.278235:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847770a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.278252:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847770a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.278265:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847770a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349919.278335:0:14140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783349919.278339:0:14140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349919.278400:0:14140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847770a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.278427:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a48477703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be44 expref: 11 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.278448:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6e00/0x68b4a22a4847770a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be44 expref: 10 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.278457:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349919.278472:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349919.278477:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6e00, rc 0) 00000100:00100000:0.0:1783349919.278567:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14360:x1869977655293056:12345-192.168.204.36@tcp:101:lctl.0 Request processed in 506us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349919.278576:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:2.0:1783349919.309325:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349919.309447:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655293184 00000100:00100000:1.0:1783349919.309471:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655293184 00000100:00100000:1.0:1783349919.309551:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:1.0:1783349919.309562:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:14361:x1869977655293184:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349919.309590:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349919.309854:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be4b expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.309942:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a48477718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.309959:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a48477718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.309974:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a48477718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349919.310051:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783349919.310056:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349919.310088:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a48477718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.310116:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be4b expref: 7 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.310134:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacae00/0x68b4a22a48477718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be4b expref: 6 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.310166:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349919.310169:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783349919.310173:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faacae00, rc 0) 00000100:00100000:1.0:1783349919.310255:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:14361:x1869977655293184:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 694us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349919.310262:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:2.0:1783349919.314013:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349919.314123:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655293312 00000100:00100000:0.0:1783349919.314137:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655293312 00000100:00100000:0.0:1783349919.314200:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:0.0:1783349919.314210:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:14361:x1869977655293312:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349919.314235:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349919.314259:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847771f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be52 expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.314337:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.314355:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.314367:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.314401:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.314408:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.314415:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317555:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48477734 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317577:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48477734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317605:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48477734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349919.317671:0:14140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783349919.317675:0:14140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349919.317700:0:14140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48477734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317713:0:14140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317719:0:14140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317727:0:14140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317732:0:14140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349919.317737:0:14140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317859:0:14140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317872:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:0.0:1783349919.317875:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349919.317879:0:14140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317885:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317910:0:14140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317915:0:14140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317922:0:14140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317927:0:14140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349919.317930:0:14140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317936:0:14140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317953:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9320c2913b00) 00010000:00010000:0.0:1783349919.317955:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349919.317958:0:14140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.317965:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847772d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.318094:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a4847771f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be52 expref: 8 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.318107:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48477734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be52 expref: 7 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.318125:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913500) 00010000:00010000:0.0:1783349919.318127:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349919.318130:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a7c00, rc 0) 00000100:00100000:0.0:1783349919.318201:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+7:14361:x1869977655293312:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 3992us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349919.318485:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:1.0:1783349919.323827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349919.323929:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655293568 00000100:00100000:3.0:1783349919.323941:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655293568 00000100:00100000:3.0:1783349919.324016:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:3.0:1783349919.324029:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+7:14361:x1869977655293568:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349919.324055:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349919.324079:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a4847773b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be59 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349919.324248:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783349919.324395:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a4847773b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be59 expref: 9 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.324410:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349919.324414:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349919.324418:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a4847773b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be59 expref: 9 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.324435:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96800, rc 0) 00000100:00100000:3.0:1783349919.324590:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+8:14361:x1869977655293568:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 564us (798us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1783349919.324599:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:2.0:1783349919.328724:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349919.329143:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655293824 00000100:00100000:1.0:1783349919.329157:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655293824 00000100:00100000:1.0:1783349919.329233:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349919.329245:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+8:14361:x1869977655293824:12345-192.168.204.36@tcp:36:lfs.0 00010000:00010000:1.0:1783349919.329323:0:14141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349919.329356:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7c00/0x68b4a22a48477734 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be52 expref: 8 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.329381:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913500) 00010000:00010000:1.0:1783349919.329394:0:14141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349919.329427:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.329454:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349919.329476:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783349919.330073:0:14141:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003879820b reply state 00000000ba807a0c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349919.330103:0:14141:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783349919.330123:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1783349919.330282:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+9:14361:x1869977655293824:12345-192.168.204.36@tcp:36:lfs.0 Request processed in 1037us (1568us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783349919.330292:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:2.0:1783349919.358027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349919.358392:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655294080 00000100:00100000:0.0:1783349919.358402:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655294080 00000100:00100000:0.0:1783349919.358468:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:0.0:1783349919.358480:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+9:14361:x1869977655294080:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349919.359056:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+10:14361:x1869977655294080:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 577us (1037us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783349919.359065:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00010000:00010000:3.0:1783349919.359334:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.359346:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.359551:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.359560:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faaca800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349919.359564:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.359571:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.359598:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:3.0:1783349919.359601:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783349919.359606:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349919.359663:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a48477749 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349919.369511:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349919.369686:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655294336 00000100:00100000:2.0:1783349919.369696:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655294336 00000100:00100000:2.0:1783349919.369758:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:2.0:1783349919.369768:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+9:14361:x1869977655294336:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349919.369831:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349919.369850:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a48477750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be60 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.369916:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.369930:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.369940:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.369966:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.369974:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.369981:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349919.370097:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783349919.370190:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370198:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370205:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370211:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002e00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349919.370215:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370222:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370234:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349919.370236:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349919.370240:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370246:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a48477757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370259:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370265:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370271:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370286:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349919.370289:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370295:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370303:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9320c3886f00) 00010000:00010000:2.0:1783349919.370305:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349919.370308:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370314:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847775e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370354:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a48477750 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be60 expref: 11 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.370364:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349919.370367:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349919.370370:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a48477750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be60 expref: 11 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349919.371451:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003000, rc 0) 00000100:00100000:2.0:1783349919.371508:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+10:14361:x1869977655294336:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1740us (2004us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783349919.371526:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:2.0:1783349919.375051:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349919.375167:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655294464 00000100:00100000:0.0:1783349919.375176:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655294464 00000100:00100000:0.0:1783349919.375277:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 26 00000100:00100000:0.0:1783349919.375286:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+10:14361:x1869977655294464:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:0.0:1783349919.375305:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349919.375333:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847776c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be67 expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.375460:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.375474:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.375490:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349919.375558:0:14140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783349919.375562:0:14140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783349919.375583:0:14140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.375609:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a4847776c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 12 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.375625:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 11 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349919.375633:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:0.0:1783349919.375636:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349919.375640:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6c00, rc 0) 00000100:00100000:0.0:1783349919.375734:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+11:14361:x1869977655294464:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 449us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349919.375749:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 26 00000040:00080000:2.0:1783349919.535102:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783349919.536104:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349920.110089:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349920.111712:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655294592 00000100:00100000:1.0:1783349920.111725:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655294592 00000100:00100000:1.0:1783349920.111868:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:1.0:1783349920.111879:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+11:14361:x1869977655294592:12345-192.168.204.36@tcp:37:lfs.0 00000100:00100000:1.0:1783349920.124243:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+11:14361:x1869977655294592:12345-192.168.204.36@tcp:37:lfs.0 Request processed in 12355us (14152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.124259:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 3 00000100:00100000:2.0:1783349920.129277:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349920.129364:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655294848 00000100:00100000:0.0:1783349920.129374:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655294848 00000100:00100000:0.0:1783349920.129435:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:0.0:1783349920.129457:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7b61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+11:14361:x1869977655294848:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349920.129960:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7b61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+12:14361:x1869977655294848:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 514us (689us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783349920.129985:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 4 00000100:00100000:0.0:1783349920.253223:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349920.253351:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655294976 00000100:00100000:2.0:1783349920.253365:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655294976 00000100:00100000:1.0:1783349920.253614:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:1.0:1783349920.253629:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14367:x1869977655294976:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349920.253657:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349920.253684:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847777a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be6e expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.253769:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.253787:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.253825:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.253861:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.253977:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.253984:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254141:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a4847778f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254151:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a4847778f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254159:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a4847778f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349920.254334:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783349920.254339:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349920.254659:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a4847778f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254677:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254684:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254690:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254708:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacba00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349920.254712:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254720:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254735:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349920.254739:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349920.254744:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254750:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacba00/0x68b4a22a48477781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254768:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254774:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254780:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.254785:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320faacbc00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349920.254788:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.255011:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.255031:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9320e0103d00) 00010000:00010000:1.0:1783349920.255034:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349920.255037:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.255042:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faacbc00/0x68b4a22a48477788 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.255085:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca000/0x68b4a22a4847777a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be6e expref: 12 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.255101:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320faaca800/0x68b4a22a4847778f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be6e expref: 11 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.255109:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:1.0:1783349920.255111:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783349920.255114:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320faaca800, rc 0) 00000100:00100000:1.0:1783349920.255196:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+11:14367:x1869977655294976:12345-192.168.204.36@tcp:101:bash.0 Request processed in 1570us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.255204:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 27 00000100:00100000:2.0:1783349920.259126:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349920.259212:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655295232 00000100:00100000:1.0:1783349920.259225:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655295232 00000100:00100000:1.0:1783349920.259301:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 28 00000100:00100000:1.0:1783349920.259312:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+11:14367:x1869977655295232:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349920.259338:0:14141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349920.259364:0:14141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051c00/0x68b4a22a48477796 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be75 expref: -99 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.259580:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.259607:0:14141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 11 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.259617:0:14141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.259658:0:14141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 11 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.259672:0:14141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 11 pid: 14140 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349920.259687:0:14141:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320de7a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14141:1869977666807680:192.168.204.36@tcp:104: 00000100:00100000:1.0:1783349920.259841:0:14141:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320fab0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783349920.264219:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349920.264574:0:14141:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320de7a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14141:1869977666807680:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349920.264615:0:14141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349920.264831:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655295360 00000100:00100000:3.0:1783349920.264841:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655295360 00010000:00010000:3.0:1783349920.264898:0:14125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 12 pid: 14140 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349920.264942:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:3.0:1783349920.264952:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+12:2361:x1869977655295360:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349920.264971:0:14125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349920.264978:0:14125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 12 pid: 14140 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.264991:0:14125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 12 pid: 14140 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.265017:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477773 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be67 expref: 12 pid: 14140 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.265033:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:3.0:1783349920.265054:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.265065:0:14125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.265073:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.265105:0:14125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349920.265164:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+11:2361:x1869977655295360:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 212us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349920.265172:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00010000:00010000:2.0:1783349920.265738:0:14141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.265748:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.265779:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.265823:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.265833:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270602:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270626:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270640:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349920.270659:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783349920.270716:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270739:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270746:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270752:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051a00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349920.270757:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270765:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270779:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349920.270781:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349920.270786:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270805:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051a00/0x68b4a22a4847779d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349920.270825:0:14141:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000420efd25 reply state 000000005efd5d28 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349920.270835:0:14141:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783349920.270878:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051c00/0x68b4a22a48477796 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 14 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270893:0:14141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 13 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.270911:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349920.270913:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783349920.270916:0:14141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003600, rc 0) 00000100:00100000:2.0:1783349920.270987:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+14:14367:x1869977655295232:12345-192.168.204.36@tcp:101:bash.0 Request processed in 11677us (11875us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783349920.271940:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 28 00010000:00010000:3.0:1783349920.275198:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.275215:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.275222:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.275229:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349920.275233:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.275241:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.275258:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9320c3886f00) 00010000:00010000:3.0:1783349920.275261:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349920.275278:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.275284:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a484777a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349920.310698:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349920.310902:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655295488 00000100:00100000:2.0:1783349920.310916:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655295488 00000100:00100000:2.0:1783349920.310996:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:2.0:1783349920.311008:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14367:x1869977655295488:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349920.311039:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349920.311066:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003e00/0x68b4a22a484777b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be7c expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311153:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311184:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311200:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349920.311251:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783349920.311256:0:14139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349920.311279:0:14139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311311:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311340:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003e00/0x68b4a22a484777b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be7c expref: 15 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311362:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be7c expref: 14 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.311372:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349920.311374:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349920.311379:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002800, rc 0) 00000100:00100000:2.0:1783349920.311464:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+14:14367:x1869977655295488:12345-192.168.204.36@tcp:101:bash.0 Request processed in 457us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349920.311471:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 29 00000100:00100000:2.0:1783349920.318117:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349920.318467:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655295744 00000100:00100000:3.0:1783349920.318481:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655295744 00000100:00100000:3.0:1783349920.318554:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:3.0:1783349920.318566:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+14:14367:x1869977655295744:12345-192.168.204.36@tcp:35:bash.0 00000100:00100000:3.0:1783349920.319748:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+15:14367:x1869977655295744:12345-192.168.204.36@tcp:35:bash.0 Request processed in 1177us (1639us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1783349920.319760:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 5 00000100:00100000:0.0:1783349920.349616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349920.349673:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349920.349722:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349920.349760:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349920.349761:0:16017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655296000 00000100:00100000:2.0:1783349920.349776:0:16017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655296000 00000100:00100000:0.0:1783349920.349827:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349920.349875:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655296256 00000100:00100000:0.0:1783349920.349880:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655296256 00000100:00100000:2.0:1783349920.349897:0:16017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655296128 00000100:00100000:2.0:1783349920.349902:0:16017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655296128 00000100:00100000:0.0:1783349920.349911:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655296384 00000100:00100000:0.0:1783349920.349917:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655296384 00000100:00100000:2.0:1783349920.349931:0:16017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:2.0:1783349920.349945:0:16017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2362:x1869977655296000:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349920.350032:0:16017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2362:x1869977655296000:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 90us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.350066:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655295872 00000100:00100000:1.0:1783349920.350072:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655295872 00000100:00100000:1.0:1783349920.350111:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 118 00000100:00100000:1.0:1783349920.350123:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d173b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2362:x1869977655295872:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349920.350161:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d173b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2362:x1869977655295872:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 43us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.350186:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 118 00000100:00100000:0.0:1783349920.359234:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:3.0:1783349920.359681:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:3.0:1783349920.359699:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2362:x1869977655296128:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:2.0:1783349920.359722:0:16017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:2.0:1783349920.359781:0:16017:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1783349920.359824:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:2.0:1783349920.359829:0:16017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783349920.359843:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2362:x1869977655296384:12345-192.168.204.36@tcp:400:kworker.0 00000100:00080000:2.0:1783349920.359888:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783349920.359894:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349920.359941:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2362:x1869977655296384:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 104us (10113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.359949:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:3.0:1783349920.364307:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2362:x1869977655296128:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 4597us (14528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349920.364326:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:0.0:1783349920.364450:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2362:x1869977655296256:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:0.0:1783349920.364517:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2362:x1869977655296256:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 5268us (14843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349920.364525:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:0.0:1783349920.461186:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349920.461297:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655296640 00000100:00100000:2.0:1783349920.461310:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655296640 00000100:00100000:2.0:1783349920.461467:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1783349920.461481:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+15:14377:x1869977655296640:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:2.0:1783349920.461524:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349920.461698:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484777c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be83 expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349920.461958:0:14140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783349920.462125:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484777c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be83 expref: 17 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.462148:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:2.0:1783349920.462155:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783349920.462161:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002a00/0x68b4a22a484777c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be83 expref: 17 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349920.462185:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002a00, rc 0) 00000100:00100000:2.0:1783349920.462352:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+16:14377:x1869977655296640:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 870us (1176us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783349920.462360:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 30 00000100:00100000:2.0:1783349920.467898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349920.467987:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655296896 00000100:00100000:3.0:1783349920.468000:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655296896 00000100:00100000:3.0:1783349920.468070:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:3.0:1783349920.468080:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+16:14377:x1869977655296896:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:3.0:1783349920.468408:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14377:x1869977655296896:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 328us (524us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1783349920.468417:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 6 00000100:00100000:0.0:1783349920.525098:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349920.525283:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655297152 00000100:00100000:3.0:1783349920.525297:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655297152 00000100:00100000:3.0:1783349920.525423:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:3.0:1783349920.525451:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14380:x1869977655297152:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349920.525499:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349920.525526:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484777d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be8a expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.525654:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484777dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.525671:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484777dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.525684:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484777dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349920.525697:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783349920.525894:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484777d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be8a expref: 20 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.525915:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484777dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be8a expref: 19 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.525936:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349920.525940:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349920.525944:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96600, rc 0) 00000100:00100000:3.0:1783349920.526022:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14380:x1869977655297152:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 589us (937us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783349920.526030:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 31 00000100:00100000:2.0:1783349920.539864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349920.539959:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655297280 00000100:00100000:1.0:1783349920.539972:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655297280 00000100:00100000:1.0:1783349920.540073:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:1.0:1783349920.540084:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14380:x1869977655297280:12345-192.168.204.36@tcp:54:lfs.0 00010000:00010000:1.0:1783349920.540175:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540197:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540212:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540245:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540257:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540266:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540274:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102050c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349920.540296:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540306:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540320:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:1.0:1783349920.540323:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349920.540329:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349920.540336:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050c00/0x68b4a22a484777ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349920.540387:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349920.540429:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14380:x1869977655297280:12345-192.168.204.36@tcp:54:lfs.0 Request processed in 346us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349920.540437:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 32 00000100:00100000:3.0:1783349920.540472:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655297408 00000100:00100000:3.0:1783349920.540483:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655297408 00000100:00100000:3.0:1783349920.540541:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:3.0:1783349920.540552:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320fb559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+19:2362:x1869977655297408:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349920.540570:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349920.540606:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a484777dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be8a expref: 19 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349920.540620:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349920.540624:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349920.545996:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320fb559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+18:2362:x1869977655297408:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 5435us (5598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349920.546011:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:0.0:1783349920.549328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349920.551042:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655297664 00000100:00100000:3.0:1783349920.551054:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655297664 00000100:00100000:2.0:1783349920.553649:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 7 00000100:00100000:2.0:1783349920.553669:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+18:14380:x1869977655297664:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1783349920.553950:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14380:x1869977655297664:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 288us (4630us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783349920.553959:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 7 00010000:00010000:3.0:1783349920.559732:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349921.133948:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349921.135113:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655297920 00000100:00100000:1.0:1783349921.135131:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655297920 00000100:00100000:1.0:1783349921.135325:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00100000:1.0:1783349921.135338:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14411:x1869977655297920:12345-192.168.204.36@tcp:101:cat.0 00010000:00010000:1.0:1783349921.135368:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349921.135394:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051000/0x68b4a22a484777f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be91 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.135769:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051400/0x68b4a22a484777f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.135787:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102051400/0x68b4a22a484777f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.135839:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051400/0x68b4a22a484777f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349921.135854:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783349921.136034:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051000/0x68b4a22a484777f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be91 expref: 22 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.136054:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051400/0x68b4a22a484777f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be91 expref: 21 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.136063:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:1.0:1783349921.136066:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349921.136070:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102051400, rc 0) 00000100:00100000:1.0:1783349921.136262:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+21:14411:x1869977655297920:12345-192.168.204.36@tcp:101:cat.0 Request processed in 926us (2326us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1783349921.136270:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 33 00000100:00080000:2.0:1783349921.136630:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349921.155181:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349921.155222:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349921.155333:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655298048 00000100:00100000:2.0:1783349921.155346:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655298048 00000100:00100000:2.0:1783349921.155441:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:2.0:1783349921.155452:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+21:2359:x1869977655298048:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349921.155478:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349921.155517:0:14126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051400/0x68b4a22a484777f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be91 expref: 21 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349921.155545:0:14126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349921.155550:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349921.155620:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+20:2359:x1869977655298048:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 170us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349921.155628:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 1 00000100:00100000:1.0:1783349921.157663:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655298304 00000100:00100000:1.0:1783349921.157680:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655298304 00000100:00100000:1.0:1783349921.157750:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:1.0:1783349921.157759:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+20:14411:x1869977655298304:12345-192.168.204.36@tcp:35:cat.0 00000100:00100000:1.0:1783349921.158677:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+21:14411:x1869977655298304:12345-192.168.204.36@tcp:35:cat.0 Request processed in 913us (3448us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783349921.158687:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 8 00000100:00100000:1.0:1783349921.272054:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349921.272269:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655298560 00000100:00100000:2.0:1783349921.272283:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655298560 00000100:00100000:2.0:1783349921.272360:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:2.0:1783349921.272955:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+21:14417:x1869977655298560:12345-192.168.204.36@tcp:101:dd.0 00010000:00010000:2.0:1783349921.272994:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349921.273021:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477806 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be98 expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349921.273170:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847780d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349921.273188:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847780d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349921.273202:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847780d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349921.273216:0:14140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783349921.273492:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477806 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be98 expref: 24 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349921.273515:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847780d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be98 expref: 23 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349921.273525:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349921.273529:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783349921.273533:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002400, rc 0) 00000100:00100000:2.0:1783349921.273736:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14417:x1869977655298560:12345-192.168.204.36@tcp:101:dd.0 Request processed in 1366us (1692us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783349921.273746:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 34 00000100:00100000:2.0:1783349921.279963:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349921.280116:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655298816 00000100:00100000:3.0:1783349921.280130:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655298816 00000100:00100000:3.0:1783349921.281787:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 35 00000100:00100000:3.0:1783349921.281827:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14417:x1869977655298816:12345-192.168.204.36@tcp:36:dd.0 00010000:00010000:3.0:1783349921.281911:0:14139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783349921.281946:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002400/0x68b4a22a4847780d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be98 expref: 23 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.281972:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002800/0x68b4a22a484777c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be7c expref: 22 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.281984:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349921.282006:0:14139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783349921.282417:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.282512:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.282524:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783349921.282587:0:14139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1783349921.282630:0:14139:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ee14b72 reply state 000000000bd93108 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349921.282641:0:14139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783349921.283012:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+24:14417:x1869977655298816:12345-192.168.204.36@tcp:36:dd.0 Request processed in 1195us (3059us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1783349921.283022:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 35 00000020:00080000:3.0:1783349921.283027:0:14139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349921.290459:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.290491:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.290500:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.290507:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349921.290513:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.290521:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.290564:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349921.290567:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349921.290573:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.290581:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847781b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349921.424131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349921.424386:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655299072 00000100:00100000:1.0:1783349921.424400:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655299072 00000100:00100000:1.0:1783349921.424550:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 9 00000100:00100000:1.0:1783349921.424563:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14417:x1869977655299072:12345-192.168.204.36@tcp:35:dd.0 00000100:00100000:1.0:1783349921.425021:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+24:14417:x1869977655299072:12345-192.168.204.36@tcp:35:dd.0 Request processed in 458us (901us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1783349921.425031:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 9 00010000:00010000:1.0:1783349921.578249:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349921.642896:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783349921.642930:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666807808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783349921.643029:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349921.645455:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666807808 00000100:00100000:1.0:1783349921.645481:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666807808 00000100:00100000:1.0:1783349921.645580:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349921.645593:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666807808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783349921.645645:0:14777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349921.645758:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1869977666807808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349921.645766:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783349921.645829:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666807936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349921.645874:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783349921.646316:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783349921.646331:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666807936 00000100:00100000:2.0:1783349921.646337:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666807936 00000100:00100000:2.0:1783349921.646371:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783349921.646397:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666807936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349921.646423:0:14778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783349921.646690:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1869977666807808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349921.651725:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666807936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5315us (5836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349921.651743:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783349921.651816:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783349921.658171:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666807936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783349921.658225:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783349921.658239:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666808064:0@lo:400:kworker.0 00000100:00100000:1.0:1783349921.658334:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349921.658641:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666808064 00000100:00100000:2.0:1783349921.658652:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666808064 00000100:00100000:2.0:1783349921.658708:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783349921.658719:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3293:x1869977666808064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783349921.658821:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3293:x1869977666808064:12345-0@lo:400:kworker.0 Request processed in 104us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349921.658831:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783349921.660374:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3293:1869977666808064:0@lo:400:kworker.0 00000100:00100000:3.0:1783349921.662716:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666808192:0@lo:400:kworker.0 00000100:00100000:3.0:1783349921.662875:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349921.663114:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666808320:0@lo:400:kworker.0 00000100:00100000:1.0:1783349921.663161:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349921.663231:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666808192 00000100:00100000:1.0:1783349921.663242:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666808192 00000100:00100000:1.0:1783349921.663319:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666808320 00000100:00100000:1.0:1783349921.663323:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666808320 00000100:00100000:0.0:1783349921.663658:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783349921.663671:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666808192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349921.663775:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783349921.663784:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666808320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349921.663842:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1869977666808320:12345-0@lo:400:kworker.0 Request processed in 59us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349921.663849:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1783349921.663874:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349921.663910:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1869977666808320:0@lo:400:kworker.0 00000100:00100000:2.0:1783349921.670616:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666808448:0@lo:400:kworker.0 00000100:00100000:2.0:1783349921.670712:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349921.671161:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666808448 00000100:00100000:1.0:1783349921.671172:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666808448 00000100:00100000:1.0:1783349921.671277:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349921.671289:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666808448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349921.671364:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1869977666808448:12345-0@lo:400:kworker.0 Request processed in 77us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349921.671372:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783349921.671435:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1869977666808448:0@lo:400:kworker.0 00000100:00100000:0.0:1783349921.671564:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1869977666808192:12345-0@lo:400:kworker.0 Request processed in 7894us (8687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349921.671948:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783349921.672360:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349921.675588:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1869977666808192:0@lo:400:kworker.0 00000100:00100000:0.0:1783349921.699854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349921.699957:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655299200 00000100:00100000:1.0:1783349921.699976:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655299200 00000100:00100000:1.0:1783349921.700111:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:1.0:1783349921.700123:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+24:14431:x1869977655299200:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:1.0:1783349921.700150:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349921.700176:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a48477822 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6be9f expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700296:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700310:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700320:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700332:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700336:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700340:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700466:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700487:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.700495:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349921.701651:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783349921.701660:0:14139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349921.701716:0:14139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701751:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701763:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701769:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701777:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701784:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349921.701789:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701941:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701959:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:1.0:1783349921.701962:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349921.701967:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701974:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701992:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.701998:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702010:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702015:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102050000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349921.702018:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702024:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702031:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9320e0103d00) 00010000:00010000:1.0:1783349921.702033:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349921.702035:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702040:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a48477830 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702091:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a48477822 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be9f expref: 26 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702106:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be9f expref: 25 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.702113:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:1.0:1783349921.702115:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349921.702118:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050600, rc 0) 00000100:00100000:1.0:1783349921.704878:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+25:14431:x1869977655299200:12345-192.168.204.36@tcp:101:stat.0 Request processed in 4738us (5020us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349921.704921:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 36 00000100:00100000:2.0:1783349921.774670:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349921.775050:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655299456 00000100:00100000:1.0:1783349921.775064:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655299456 00000100:00100000:1.0:1783349921.775147:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 37 00000100:00100000:1.0:1783349921.775158:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+25:14437:x1869977655299456:12345-192.168.204.36@tcp:36:truncate.0 00010000:00010000:1.0:1783349921.775244:0:14141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783349921.775290:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477837 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be9f expref: 25 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.775317:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:1.0:1783349921.775322:0:14141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783349921.775633:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.775650:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349921.775662:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783349921.775720:0:14141:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1783349921.775746:0:14141:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047f35bbf reply state 00000000dba8cc59 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349921.775757:0:14141:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783349921.775957:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+27:14437:x1869977655299456:12345-192.168.204.36@tcp:36:truncate.0 Request processed in 798us (1300us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1783349921.775966:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 37 00000020:00080000:1.0:1783349921.775986:0:14141:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349921.779856:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.779878:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.779886:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.779894:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349921.779900:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.779909:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.779929:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349921.779932:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349921.779956:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349921.779963:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051200/0x68b4a22a4847783e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349922.000188:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349922.000325:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655299584 00000100:00100000:1.0:1783349922.000338:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655299584 00000100:00100000:1.0:1783349922.000480:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:1.0:1783349922.000492:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+26:14451:x1869977655299584:12345-192.168.204.36@tcp:101:stat.0 00010000:00010000:1.0:1783349922.000529:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349922.000558:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477845 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bea6 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.000679:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.000698:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.000715:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.000734:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.000743:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.000750:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001236:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001247:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001277:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349922.001326:0:14798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1783349922.001332:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783349922.001358:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001384:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001395:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001402:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001417:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001424:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102050000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349922.001428:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001437:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001450:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:1.0:1783349922.001454:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349922.001459:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001488:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a4847784c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001506:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001512:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001517:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001522:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102051800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:1.0:1783349922.001525:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001532:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001539:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9320e0103d00) 00010000:00010000:1.0:1783349922.001541:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783349922.001544:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001550:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051800/0x68b4a22a48477853 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001934:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050600/0x68b4a22a48477845 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 28 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001962:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 27 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.001970:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:1.0:1783349922.001972:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783349922.001974:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102050400, rc 0) 00000100:00100000:1.0:1783349922.002062:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+27:14451:x1869977655299584:12345-192.168.204.36@tcp:101:stat.0 Request processed in 1572us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349922.002072:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 38 00000100:00100000:2.0:1783349922.135740:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.136233:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655299840 00000100:00100000:3.0:1783349922.136249:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655299840 00000100:00100000:3.0:1783349922.136343:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:3.0:1783349922.136354:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+27:14461:x1869977655299840:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:3.0:1783349922.136383:0:14141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349922.136412:0:14141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bead expref: -99 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349922.136588:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783349922.136741:0:14141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477861 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bead expref: 29 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.136758:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:3.0:1783349922.136761:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783349922.136766:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a48477861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bead expref: 29 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.136782:0:14141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96600, rc 0) 00000100:00100000:3.0:1783349922.137014:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+28:14461:x1869977655299840:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 661us (1290us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1783349922.137023:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 39 00000100:00100000:2.0:1783349922.140772:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349922.141070:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655300096 00000100:00100000:0.0:1783349922.141084:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655300096 00000100:00100000:0.0:1783349922.141189:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:0.0:1783349922.141200:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320f7b61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+28:14461:x1869977655300096:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:0.0:1783349922.141556:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320f7b61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+29:14461:x1869977655300096:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 356us (797us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1783349922.141565:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 10 00000100:00100000:2.0:1783349922.203305:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.203954:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655300352 00000100:00100000:3.0:1783349922.203969:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655300352 00000100:00100000:3.0:1783349922.204143:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:3.0:1783349922.204155:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+29:14467:x1869977655300352:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349922.204188:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349922.204215:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847786f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6beb4 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204356:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204382:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204393:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 30 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204471:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204519:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 30 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204536:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 30 pid: 14798 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.204552:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec482300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14139:1869977666808576:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349922.204855:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.204879:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.204890:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec483800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14139:1869977666808704:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349922.204925:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070540 going to sleep for 11 seconds 00000100:00100000:3.0:1783349922.207350:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec482300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14139:1869977666808576:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349922.207370:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec483800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14139:1869977666808704:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349922.207401:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349922.209011:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.209588:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655300480 00000100:00100000:3.0:1783349922.209602:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655300480 00010000:00010000:3.0:1783349922.209654:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 31 pid: 14798 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.209713:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:3.0:1783349922.209723:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c54d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+31:2361:x1869977655300480:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349922.209746:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349922.209754:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 31 pid: 14798 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.209768:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 31 pid: 14798 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.209846:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050400/0x68b4a22a4847785a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bea6 expref: 31 pid: 14798 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.209886:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349922.209892:0:14124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.209902:0:14124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.209908:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349922.209975:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c54d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+30:2361:x1869977655300480:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 253us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349922.209983:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:2.0:1783349922.210113:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.210601:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655300608 00000100:00100000:3.0:1783349922.210608:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655300608 00010000:00010000:3.0:1783349922.210627:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.210645:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:3.0:1783349922.210653:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+30:2361:x1869977655300608:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349922.210663:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349922.210668:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.210678:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.210694:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a484777ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6be75 expref: 30 pid: 14141 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.210721:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349922.210726:0:14124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.210734:0:14124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.210742:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.210779:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349922.210858:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+29:2361:x1869977655300608:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 204us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349922.210866:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00010000:00010000:2.0:1783349922.211425:0:14139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.211437:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349922.211480:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1783349922.211683:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96600/0x68b4a22a4847786f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 30 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.211703:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 29 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.211712:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349922.211715:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783349922.211718:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac96800, rc 0) 00000100:00100000:2.0:1783349922.211773:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+29:14467:x1869977655300352:12345-192.168.204.36@tcp:101:bash.0 Request processed in 7620us (8483us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1783349922.211781:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 40 00000100:00100000:0.0:1783349922.214312:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.214401:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655300864 00000100:00100000:2.0:1783349922.214424:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655300864 00000100:00100000:2.0:1783349922.214508:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 41 00000100:00100000:2.0:1783349922.214520:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+29:14467:x1869977655300864:12345-192.168.204.36@tcp:36:bash.0 00010000:00010000:2.0:1783349922.214918:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.214941:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.214955:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783349922.215371:0:14140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1783349922.215519:0:14140:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045937774 reply state 00000000a2e7910f transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349922.215531:0:14140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783349922.215670:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+32:14467:x1869977655300864:12345-192.168.204.36@tcp:36:bash.0 Request processed in 1148us (1367us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1783349922.215679:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 41 00000020:00080000:2.0:1783349922.215685:0:14140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783349922.219687:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.219710:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.219718:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.219725:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349922.219730:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.219739:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.219779:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349922.219783:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349922.219788:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.219836:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477884 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349922.222325:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.222456:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655300992 00000100:00100000:2.0:1783349922.222481:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655300992 00000100:00100000:2.0:1783349922.222572:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:2.0:1783349922.222584:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+31:14467:x1869977655300992:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349922.222615:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349922.222640:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847788b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bebb expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.222717:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847788b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bebb expref: 32 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.222735:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847788b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bebb expref: 32 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.222758:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:2.0:1783349922.222761:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349922.222765:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003c00, rc 0) 00000100:00100000:2.0:1783349922.222864:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+32:14467:x1869977655300992:12345-192.168.204.36@tcp:101:bash.0 Request processed in 283us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349922.222872:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 42 00000100:00100000:0.0:1783349922.234157:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.244172:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655301120 00000100:00100000:3.0:1783349922.244198:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655301120 00000100:00100000:3.0:1783349922.244881:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:3.0:1783349922.244895:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+32:14467:x1869977655301120:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:3.0:1783349922.244923:0:14141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783349922.244950:0:14141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48477892 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bec2 expref: -99 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.245095:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.245319:0:14141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 33 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.245332:0:14141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.245379:0:14141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 33 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.245394:0:14141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 33 pid: 14139 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.245428:0:14141:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14141:1869977666808832:192.168.204.36@tcp:104: 00000100:00100000:3.0:1783349922.245656:0:14141:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320e4070000 going to sleep for 11 seconds 00000100:00100000:1.0:1783349922.253903:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.254007:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655301248 00000100:00100000:3.0:1783349922.254019:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655301248 00010000:00010000:3.0:1783349922.254070:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 34 pid: 14139 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.254373:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:3.0:1783349922.254385:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+34:2362:x1869977655301248:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783349922.254405:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783349922.254413:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 34 pid: 14139 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254429:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 34 pid: 14139 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254467:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349922.254474:0:14124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254486:0:14124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254494:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254517:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349922.254618:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+34:2362:x1869977655301248:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 235us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349922.254628:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00010000:00010000:3.0:1783349922.254697:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a48477876 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beb4 expref: 33 pid: 14139 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.254715:0:14141:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14141:1869977666808832:192.168.204.36@tcp:104: 00010000:00010000:3.0:1783349922.254740:0:14141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254749:0:14141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254754:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349922.254842:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783349922.254848:0:14141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349922.254874:0:14141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254913:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a48477892 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec2 expref: 33 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254930:0:14141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec2 expref: 32 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.254938:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349922.254941:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783349922.254951:0:14141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fac97200, rc 0) 00000100:00100000:3.0:1783349922.254982:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+32:14467:x1869977655301120:12345-192.168.204.36@tcp:101:bash.0 Request processed in 10091us (20843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349922.256751:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 43 00000100:00100000:1.0:1783349922.265132:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.265727:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655301504 00000100:00100000:3.0:1783349922.265741:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655301504 00000100:00100000:3.0:1783349922.265848:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:3.0:1783349922.265860:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+32:14467:x1869977655301504:12345-192.168.204.36@tcp:103:bash.0 00010000:00010000:3.0:1783349922.265882:0:14125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783349922.265912:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a48477899 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec2 expref: 32 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.265940:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003c00/0x68b4a22a4847788b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bebb expref: 31 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.265952:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320c3886400) 00010000:00010000:3.0:1783349922.265965:0:14125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783349922.266050:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+30:14467:x1869977655301504:12345-192.168.204.36@tcp:103:bash.0 Request processed in 192us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349922.266059:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 2 00000100:00100000:2.0:1783349922.279884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349922.279972:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655301632 00000100:00100000:1.0:1783349922.279986:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655301632 00000100:00100000:1.0:1783349922.280068:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:1.0:1783349922.280280:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+30:14467:x1869977655301632:12345-192.168.204.36@tcp:58:bash.0 00010000:00010000:1.0:1783349922.280424:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.280445:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.280703:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783349922.284657:0:14798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783349922.284776:0:14798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1783349922.284917:0:14798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1783349922.285835:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+30:14467:x1869977655301632:12345-192.168.204.36@tcp:58:bash.0 Request processed in 5746us (5963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349922.285851:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 44 00000100:00100000:0.0:1783349922.291666:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.291782:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655301760 00000100:00100000:2.0:1783349922.291824:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655301760 00000100:00100000:2.0:1783349922.291939:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 45 00000100:00100000:2.0:1783349922.291951:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+30:14467:x1869977655301760:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:2.0:1783349922.291977:0:14140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349922.292006:0:14140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bec9 expref: -99 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.292078:0:14140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.292092:0:14140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 31 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.292113:0:14140:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.292128:0:14140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 31 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.292146:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:2.0:1783349922.292159:0:14140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349922.292165:0:14140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 31 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.292174:0:14140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002e00, rc 0) 00000100:00100000:2.0:1783349922.292241:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+31:14467:x1869977655301760:12345-192.168.204.36@tcp:101:bash.0 Request processed in 294us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349922.292269:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 45 00010000:00010000:3.0:1783349922.603192:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783349922.758175:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:1.0:1783349922.758199:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1783349922.758229:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000040:00080000:2.0:1783349922.794169:0:14173:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783349922.794183:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783349922.794248:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783349922.794288:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783349922.794694:0:14173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8610e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14173:1869977666808960:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783349922.796563:0:14173:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0bf6900 going to sleep for 11 seconds 00000100:00100000:0.0:1783349922.817501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.817916:0:14173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8610e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14173:1869977666808960:192.168.204.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783349922.822480:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655301888 00000100:00100000:1.0:1783349922.822502:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655301888 00000100:00100000:1.0:1783349922.822593:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:1.0:1783349922.822607:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655301888:12345-192.168.204.36@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783349922.822738:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655301888:12345-192.168.204.36@tcp:900:lhsmtool_posix.0 Request processed in 133us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349922.822748:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:1.0:1783349922.833623:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349922.833876:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655302016 00000100:00100000:0.0:1783349922.833889:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655302016 00000100:00100000:0.0:1783349922.833972:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:0.0:1783349922.833985:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320de7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655302016:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783349922.834040:0:14139:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783349922.834200:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320de7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655302016:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 217us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349922.834219:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 46 00000100:00100000:0.0:1783349922.841689:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.841762:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655302144 00000100:00100000:3.0:1783349922.841774:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655302144 00000100:00100000:3.0:1783349922.841890:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:3.0:1783349922.841903:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655302144:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783349922.841994:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.842036:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.842051:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845698:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845723:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845739:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845771:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845781:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845788:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783349922.845850:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783349922.845854:0:14141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783349922.845867:0:14141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845879:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845905:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845912:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845918:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349922.845922:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845931:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845944:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103400) 00010000:00010000:3.0:1783349922.845947:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349922.845952:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845959:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97200/0x68b4a22a484778ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845977:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845984:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845990:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.845995:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac97c00 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349922.846003:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846010:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846017:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9320c2b35d00) 00010000:00010000:3.0:1783349922.846019:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349922.846022:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846028:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac97c00/0x68b4a22a484778b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846044:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846050:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846055:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846060:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fac96800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349922.846063:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846069:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846076:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:3.0:1783349922.846078:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349922.846088:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.846094:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fac96800/0x68b4a22a484778bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349922.846191:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655302144:12345-192.168.204.36@tcp:34:lhsmtool_posix.0 Request processed in 4284us (4600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349922.846201:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 47 00000100:00100000:1.0:1783349922.856497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349922.856642:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655302400 00000100:00100000:0.0:1783349922.856658:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655302400 00000100:00100000:0.0:1783349922.856738:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:0.0:1783349922.856748:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+10:14468:x1869977655302400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349922.856770:0:14139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349922.856836:0:14139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a484778c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bed0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.856943:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.856959:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.856970:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783349922.856982:0:14139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783349922.863911:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.863928:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.863935:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.863942:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349922.863958:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.863966:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.863982:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:0.0:1783349922.863985:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783349922.864000:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.864006:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.864074:0:14139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a484778c3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bed0 expref: 12 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.864085:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9320e0103400) 00010000:00010000:0.0:1783349922.864088:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783349922.864092:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a484778c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bed0 expref: 12 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.864101:0:14139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6c00, rc 0) 00000100:00100000:0.0:1783349922.864233:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+11:14468:x1869977655302400:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 7485us (7751us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1783349922.864244:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 48 00000100:00100000:2.0:1783349922.868064:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349922.868169:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655302528 00000100:00100000:0.0:1783349922.868334:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655302528 00000100:00100000:0.0:1783349922.868471:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:0.0:1783349922.868482:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+11:14468:x1869977655302528:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783349922.868528:0:14140:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783349922.868687:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+11:14468:x1869977655302528:12345-192.168.204.36@tcp:53:lhsmtool_posix.0 Request processed in 206us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349922.868696:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 49 00000100:00100000:2.0:1783349922.874896:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349922.874977:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655302784 00000100:00100000:0.0:1783349922.874988:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655302784 00000100:00100000:0.0:1783349922.875056:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:0.0:1783349922.875066:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+11:14468:x1869977655302784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349922.875087:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349922.875107:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a484778d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bed7 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783349922.875989:0:14798:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1783349922.875997:0:14798:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1783349922.876042:0:14798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1783349922.876306:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.876322:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.876334:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.876387:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a484778d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bed7 expref: 14 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.876405:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bed7 expref: 13 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.876421:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:0.0:1783349922.876424:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783349922.876428:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6200, rc 0) 00000100:00100000:0.0:1783349922.876496:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655302784:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 1432us (1610us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783349922.876505:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 50 00000100:00100000:1.0:1783349922.882172:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349922.891644:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655303040 00000100:00100000:3.0:1783349922.891658:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655303040 00000100:00100000:2.0:1783349922.891865:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:2.0:1783349922.891877:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655303040:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349922.891936:0:14141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349922.891963:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6200/0x68b4a22a484778df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bed7 expref: 13 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.891983:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913f00) 00010000:00010000:2.0:1783349922.891994:0:14141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783349922.892015:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.892028:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.892037:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.892073:0:14141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.892082:0:14141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.892090:0:14141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896706:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896724:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896732:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896739:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349922.896743:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896751:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896768:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349922.896771:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349922.896776:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896783:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003000/0x68b4a22a484778ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896833:0:14141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896839:0:14141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896844:0:14141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896849:0:14141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349922.896852:0:14141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896857:0:14141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896864:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5d7acbfc (ffff9320c3886300) 00010000:00010000:2.0:1783349922.896866:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349922.896869:0:14141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.896874:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a484778f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5d7acbfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349922.896980:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+12:14468:x1869977655303040:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 5101us (14814us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783349922.896989:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 51 00000100:00100000:1.0:1783349922.899787:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349922.899938:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655303168 00000100:00100000:0.0:1783349922.899948:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655303168 00000100:00100000:0.0:1783349922.900010:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:0.0:1783349922.900020:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+12:14468:x1869977655303168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783349922.900040:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783349922.900061:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a484778fb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bede expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.900096:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477902 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.900109:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.900120:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477902 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.900216:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a7400/0x68b4a22a484778fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bede expref: 14 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.900233:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6c00/0x68b4a22a48477902 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bede expref: 13 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349922.900248:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:0.0:1783349922.900251:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349922.900254:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320fb4a6c00, rc 0) 00000100:00100000:0.0:1783349922.900312:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655303168:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 294us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349922.900319:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 52 00000100:00100000:0.0:1783349922.903039:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.904028:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655303424 00000100:00100000:2.0:1783349922.904040:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655303424 00000100:00100000:2.0:1783349922.904191:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 53 00000100:00100000:2.0:1783349922.904391:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655303424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783349922.905305:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.905325:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.905337:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783349922.925590:0:14140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1783349922.925614:0:14140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309987820902ns, next at 310987817254ns, rc = 0 00000004:00010000:0.0:1783349922.925740:0:14140:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000081731cf6 reply state 000000009cd2f5fa transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349922.925752:0:14140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783349922.925884:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+15:14468:x1869977655303424:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 21492us (22849us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1783349922.925893:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 53 00010000:00010000:3.0:1783349922.930018:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.930035:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.930043:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.930050:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349922.930055:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.930064:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.930090:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:3.0:1783349922.930094:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783349922.930099:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349922.930106:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003600/0x68b4a22a48477909 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349922.934470:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.934589:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655303552 00000100:00100000:2.0:1783349922.934600:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655303552 00000100:00100000:2.0:1783349922.934657:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:2.0:1783349922.934667:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+14:14468:x1869977655303552:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349922.934694:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349922.934715:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bee5 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.934834:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 15 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.934849:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 15 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.934869:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:2.0:1783349922.934872:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783349922.934876:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003800, rc 0) 00000100:00100000:2.0:1783349922.934926:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+15:14468:x1869977655303552:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 260us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349922.934946:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 54 00000100:00100000:1.0:1783349922.939106:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.939224:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655303680 00000100:00100000:2.0:1783349922.939237:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655303680 00000100:00100000:2.0:1783349922.939320:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:2.0:1783349922.939333:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2361:x1869977655303680:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783349922.939583:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349922.939836:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2361:x1869977655303680:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 463us (700us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783349922.939846:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:1.0:1783349922.944137:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.944465:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655303936 00000100:00100000:2.0:1783349922.944480:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655303936 00000100:00100000:2.0:1783349922.944615:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:2.0:1783349922.944625:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+15:14468:x1869977655303936:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783349922.946325:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+16:14468:x1869977655303936:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 1692us (2194us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1783349922.946338:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 11 00000100:00100000:0.0:1783349922.959744:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349922.960024:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655304192 00000100:00100000:1.0:1783349922.960046:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655304192 00000100:00100000:1.0:1783349922.960168:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:1.0:1783349922.960182:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+16:14468:x1869977655304192:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783349922.960769:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+16:14468:x1869977655304192:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 587us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349922.960779:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 55 00000100:00100000:1.0:1783349922.966089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.966354:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655304320 00000100:00100000:2.0:1783349922.966369:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655304320 00000100:00100000:2.0:1783349922.966907:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1783349922.966921:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+16:14468:x1869977655304320:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349922.966953:0:14798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349922.966980:0:14798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003e00/0x68b4a22a48477917 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6beec expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.967079:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847791e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.967121:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847791e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.967138:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847791e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783349922.968321:0:14798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783349922.968357:0:14798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847791e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.968762:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003e00/0x68b4a22a48477917 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beec expref: 18 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.968787:0:14798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847791e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beec expref: 17 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349922.968909:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:2.0:1783349922.968914:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783349922.968918:0:14798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9002c00, rc 0) 00000100:00100000:2.0:1783349922.969094:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14468:x1869977655304320:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 2174us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349922.969104:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 56 00000100:00100000:2.0:1783349922.976993:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349922.977118:0:16265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655304448 00000100:00100000:1.0:1783349922.977131:0:16265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655304448 00000100:00100000:1.0:1783349922.977540:0:16265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:1.0:1783349922.977566:0:16265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2361:x1869977655304448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783349922.977602:0:16265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349922.977633:0:16265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bef3 expref: -99 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349922.977669:0:16265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4bc2a2, blocks: 0x1 00010000:00010000:1.0:1783349922.977696:0:16265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1783349922.977701:0:16265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349922.977714:0:16265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 7 pid: 16265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.977740:0:16265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 7 pid: 16265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349922.977757:0:16265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102051c00, rc 0) 00000100:00100000:1.0:1783349922.977892:0:16265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e57dc1c2-2520-4aea-8a67-c57c01297213+7:2361:x1869977655304448:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 343us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349922.977901:0:16265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:1.0:1783349922.987181:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.987486:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655304704 00000100:00100000:2.0:1783349922.987499:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655304704 00000100:00100000:2.0:1783349922.987692:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:2.0:1783349922.987704:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14468:x1869977655304704:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783349922.987860:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14468:x1869977655304704:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 158us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349922.987881:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 57 00000100:00100000:0.0:1783349922.990612:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349922.990768:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655304832 00000100:00100000:2.0:1783349922.990782:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655304832 00000100:00100000:2.0:1783349922.990889:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:2.0:1783349922.990900:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14468:x1869977655304832:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783349923.103884:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:1.0:1783349923.107836:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1783349923.107869:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1783349923.108295:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783349923.108320:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320ec480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666809088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783349923.108432:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783349923.108988:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666809088 00000100:00100000:3.0:1783349923.108999:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666809088 00000100:00100000:3.0:1783349923.109086:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783349923.109097:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1869977666809088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783349923.109308:0:14776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783349923.109313:0:14776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1783349923.109315:0:14776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783349923.109318:0:14776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783349922 -> 1783349922 00002000:00010000:3.0:1783349923.109320:0:14776:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783349923.109395:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1869977666809088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (962us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783349923.109403:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783349923.110671:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1783349923.110741:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9320ec480e00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1783349923.110754:0:3293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320ec480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1869977666809088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783349923.111331:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655304832:12345-192.168.204.36@tcp:44:lhsmtool_posix.0 Request processed in 120426us (120736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.111345:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 58 00000100:00100000:1.0:1783349923.117921:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349923.118473:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655304960 00000100:00100000:3.0:1783349923.118486:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655304960 00000100:00100000:3.0:1783349923.118754:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:3.0:1783349923.118766:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+7:2362:x1869977655304960:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783349923.118941:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+7:2362:x1869977655304960:12345-192.168.204.36@tcp:16:lhsmtool_posix.0 Request processed in 177us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349923.118949:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:1.0:1783349923.131170:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349923.131301:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655305216 00000100:00100000:0.0:1783349923.131315:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655305216 00000100:00100000:0.0:1783349923.131430:0:14140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:0.0:1783349923.131452:0:14140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655305216:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783349923.131943:0:14140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349923.131982:0:14140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002c00/0x68b4a22a4847791e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6beec expref: 13 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.132006:0:14140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:0.0:1783349923.132012:0:14140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783349923.132054:0:14140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.132070:0:14140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.132080:0:14140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783349923.132334:0:14140:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1f37306 reply state 0000000074534b44 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.132346:0:14140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:2.0:1783349923.133358:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783349923.145906:0:14140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+14:14468:x1869977655305216:12345-192.168.204.36@tcp:36:lhsmtool_posix.0 Request processed in 14449us (14734us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1783349923.145940:0:14140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 59 00000100:00100000:1.0:1783349923.149303:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349923.149413:0:16265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655305344 00000100:00100000:2.0:1783349923.149426:0:16265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655305344 00000100:00100000:2.0:1783349923.149514:0:16265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349923.149526:0:16265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e57dc1c2-2520-4aea-8a67-c57c01297213+7:14468:x1869977655305344:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783349923.149559:0:16265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783349923.149582:0:16265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6befa expref: -99 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.149625:0:16265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 8 pid: 16265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.149636:0:16265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349923.149641:0:16265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349923.149666:0:16265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 8 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.149711:0:16265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 8 pid: 16265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.149727:0:16265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 8 pid: 16265 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349923.149745:0:16265:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16265:1869977666809216:192.168.204.36@tcp:104: 00000100:00100000:2.0:1783349923.149892:0:16265:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d0bf6900 going to sleep for 11 seconds 00010000:00010000:3.0:1783349923.150876:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.150892:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.150899:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.150921:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:3.0:1783349923.150926:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.150934:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.150957:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:3.0:1783349923.150960:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783349923.150964:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.150970:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847792c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.153430:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349923.153687:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655305472 00000100:00100000:2.0:1783349923.153699:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655305472 00010000:00010000:2.0:1783349923.153755:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 9 pid: 16265 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349923.153846:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:2.0:1783349923.153858:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+9:2362:x1869977655305472:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349923.153878:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349923.153907:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 9 pid: 16265 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.153925:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 9 pid: 16265 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.153956:0:14126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349923.153980:0:14126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783349923.153988:0:14126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.154000:0:14126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.154052:0:14126:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349923.154071:0:14126:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8611f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14126:1869977666809344:192.168.204.36@tcp:105: 00000100:00100000:2.0:1783349923.154171:0:14126:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320c2bcf9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783349923.154965:0:16265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a48477925 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bef3 expref: 9 pid: 16265 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783349923.154989:0:16265:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8611880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16265:1869977666809216:192.168.204.36@tcp:104: 00010000:00010000:1.0:1783349923.155022:0:16265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 8 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.155036:0:16265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9320c9003200, rc 0) 00000100:00100000:1.0:1783349923.155099:0:16265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e57dc1c2-2520-4aea-8a67-c57c01297213+8:14468:x1869977655305344:12345-192.168.204.36@tcp:101:lhsmtool_posix.0 Request processed in 5575us (5810us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.155110:0:16265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:1.0:1783349923.164376:0:14126:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8611f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14126:1869977666809344:192.168.204.36@tcp:105: 00010000:00010000:1.0:1783349923.164419:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783349923.164518:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+7:2362:x1869977655305472:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 10661us (11100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.164532:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:0.0:1783349923.177500:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349923.177615:0:16017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655305600 00000100:00100000:3.0:1783349923.177629:0:16017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655305600 00000100:00100000:3.0:1783349923.177707:0:16017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:3.0:1783349923.177720:0:16017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+7:2361:x1869977655305600:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783349923.178030:0:16017:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783349923.178035:0:16017:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783349921 00002000:00010000:3.0:1783349923.178037:0:16017:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783349919 00002000:00010000:3.0:1783349923.178040:0:16017:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783349922 -> 1783349921 00002000:00010000:3.0:1783349923.178042:0:16017:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783349923.178131:0:16017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+8:2361:x1869977655305600:12345-192.168.204.36@tcp:2:lhsmtool_posix.0 Request processed in 412us (653us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783349923.178140:0:16017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 17 00000100:00100000:2.0:1783349923.183570:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349923.183761:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655305728 00000100:00100000:0.0:1783349923.183775:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655305728 00000100:00100000:0.0:1783349923.183893:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:0.0:1783349923.183905:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+8:2362:x1869977655305728:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783349923.183971:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.184000:0:14774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 8 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.184032:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783349923.184038:0:14774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349923.184043:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.184097:0:14774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 8 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.184114:0:14774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 8 pid: 16265 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.184134:0:14774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14774:1869977666809472:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349923.184254:0:14774:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1783349923.192829:0:14774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14774:1869977666809472:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349923.192877:0:14774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349923.193111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349923.193304:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655305856 00000100:00100000:0.0:1783349923.193313:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655305856 00010000:00010000:0.0:1783349923.193388:0:14124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.193434:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:0.0:1783349923.193454:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+9:2361:x1869977655305856:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783349923.193506:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783349923.193537:0:14124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.193552:0:14124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.193586:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002224330d/0x68b4a22a48477933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6befa expref: 9 pid: 16265 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.193608:0:14124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349923.193613:0:14124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783349923.193619:0:14124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.193630:0:14124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.193670:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783349923.193731:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+8:2361:x1869977655305856:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 288us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349923.193740:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00010000:00010000:3.0:1783349923.194585:0:14774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194615:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194655:0:14774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194664:0:14774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194673:0:14774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194681:0:14774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a7800 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:3.0:1783349923.194686:0:14774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194696:0:14774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194715:0:14774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783349923.194723:0:14774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ff7f2f/0x68b4a22a4847793a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783349923.194871:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+7:2362:x1869977655305728:12345-192.168.204.36@tcp:1:lhsmtool_posix.0 Request processed in 10964us (11314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349923.194882:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:2.0:1783349923.200148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349923.200647:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655306112 00000100:00100000:0.0:1783349923.200662:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655306112 00000100:00100000:0.0:1783349923.200752:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 60 00000100:00100000:0.0:1783349923.200765:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+13:14468:x1869977655306112:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783349923.200940:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.200963:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.200978:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.201335:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.201352:0:14798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 14 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.201361:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.201410:0:14798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 14 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.201428:0:14798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 14 pid: 14798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.201461:0:14798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14798:1869977666809600:192.168.204.36@tcp:104: 00000100:00100000:0.0:1783349923.202922:0:14798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fa240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349923.216940:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349923.217322:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655306240 00000100:00100000:2.0:1783349923.217335:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655306240 00010000:00010000:2.0:1783349923.217402:0:14126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 15 pid: 14798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349923.217465:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 16 00000100:00100000:2.0:1783349923.217475:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+15:2362:x1869977655306240:12345-192.168.204.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783349923.217508:0:14126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783349923.217517:0:14126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 15 pid: 14798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.217559:0:14126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 15 pid: 14798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.217589:0:14126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:2.0:1783349923.217595:0:14126:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.217608:0:14126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.217616:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.217641:0:14126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783349923.217734:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+15:2362:x1869977655306240:12345-192.168.204.36@tcp:103:ldlm_bl.0 Request processed in 259us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349923.217743:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 16 00010000:00010000:0.0:1783349923.218478:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003800/0x68b4a22a48477910 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bee5 expref: 14 pid: 14798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.218529:0:14798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14798:1869977666809600:192.168.204.36@tcp:104: 00010000:00010000:0.0:1783349923.218561:0:14798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.218572:0:14798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.218578:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783349923.218890:0:14798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1783349923.219067:0:14798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1783349923.219115:0:14798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1783349923.219221:0:14798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14798:1869977666809728:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783349923.226837:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.227851:0:14798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783349923.228699:0:14144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666809728 00000100:00100000:2.0:1783349923.228717:0:14144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666809728 00000100:00100000:2.0:1783349923.245500:0:14144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783349923.245527:0:14144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14798:x1869977666809728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783349923.245711:0:14144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14798:x1869977666809728:12345-0@lo:1000:mdt00_003.0 Request processed in 197us (18880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349923.245720:0:14144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783349923.245851:0:14798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14798:1869977666809728:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1783349923.246604:0:14798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1783349923.246856:0:14798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14798:1869977666809856:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783349923.246917:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349923.246975:0:14798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fa240 going to sleep for 11 seconds 00000100:00100000:1.0:1783349923.247052:0:14144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666809856 00000100:00100000:1.0:1783349923.247065:0:14144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666809856 00000100:00100000:1.0:1783349923.247127:0:14144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783349923.247136:0:14144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14798:x1869977666809856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783349923.247396:0:14144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14798:x1869977666809856:12345-0@lo:1000:mdt00_003.0 Request processed in 250us (467us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783349923.247411:0:14144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783349923.247829:0:14798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a11500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14798:1869977666809856:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1783349923.247867:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247877:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247896:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247903:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349923.247907:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247915:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247930:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:0.0:1783349923.247934:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349923.247938:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247945:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a48477948 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247976:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247983:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247988:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.247994:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff932102050000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349923.247997:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.248012:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.248021:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:0.0:1783349923.248023:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783349923.248031:0:14798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 17 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.248042:0:14798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 17 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.248052:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 17 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.248103:0:14798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002e00/0x68b4a22a484778a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bec9 expref: 17 pid: 14140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.248116:0:14798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320d6a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14798:1869977666809984:192.168.204.36@tcp:105: 00000100:00100000:0.0:1783349923.248176:0:14798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9320d21fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783349923.262777:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349923.262977:0:14798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320d6a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14798:1869977666809984:192.168.204.36@tcp:105: 00010000:00010000:0.0:1783349923.263018:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263031:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102050000/0x68b4a22a484778a0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263077:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263114:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263127:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263141:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263148:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263155:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263161:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6800 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349923.263165:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263173:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263186:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:0.0:1783349923.263189:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783349923.263193:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263199:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6800/0x68b4a22a4847794f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263224:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263237:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263243:0:14798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263248:0:14798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320fb4a6600 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:0.0:1783349923.263251:0:14798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263257:0:14798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263266:0:14798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:0.0:1783349923.263268:0:14798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783349923.263271:0:14798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783349923.263277:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320fb4a6600/0x68b4a22a48477941 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783349923.263891:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14468:x1869977655306112:12345-192.168.204.36@tcp:57:lhsmtool_posix.0 Request processed in 63123us (63751us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1783349923.263904:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 60 00000020:00080000:0.0:1783349923.263912:0:14798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1783349923.264223:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655306368 00000100:00100000:2.0:1783349923.264233:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655306368 00000100:00100000:2.0:1783349923.264286:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 12 00000100:00100000:2.0:1783349923.264298:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14467:x1869977655306368:12345-192.168.204.36@tcp:49:bash.0 00000100:00100000:2.0:1783349923.264459:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14467:x1869977655306368:12345-192.168.204.36@tcp:49:bash.0 Request processed in 163us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349923.264466:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 12 00000040:00080000:1.0:1783349923.265069:0:14173:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783349923.265075:0:14173:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783349923.265109:0:14173:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783349923.265119:0:14173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783349923.281168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349923.285949:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655306624 00000100:00100000:2.0:1783349923.285972:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655306624 00000100:00100000:2.0:1783349923.286059:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 13 00000100:00100000:2.0:1783349923.286071:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d6a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+17:14468:x1869977655306624:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783349923.292107:0:14142:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783349923.292238:0:14142:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1783349923.292305:0:14142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.292327:0:14142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.292340:0:14142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.292351:0:14142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.292357:0:14142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.292364:0:14142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.292941:0:14142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783349923.293104:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d6a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14468:x1869977655306624:12345-192.168.204.36@tcp:35:lhsmtool_posix.0 Request processed in 7028us (11944us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1783349923.293130:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 13 00000020:00080000:2.0:1783349923.293138:0:14142:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783349923.297283:0:14127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783349923.297303:0:14127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.297785:0:14127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003a00 already unused, calling callback (ffffffffc1720d40) 00010000:00010000:1.0:1783349923.297810:0:14127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.297825:0:14127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.297849:0:14127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9320c2913900) 00010000:00010000:1.0:1783349923.297853:0:14127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783349923.297859:0:14127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.297865:0:14127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003a00/0x68b4a22a48477956 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14142 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.297884:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349923.297886:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349923.297887:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783349923.303098:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349923.305195:0:16265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655306752 00000100:00100000:1.0:1783349923.305213:0:16265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655306752 00000100:00100000:1.0:1783349923.306005:0:16265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:1.0:1783349923.306025:0:16265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e57dc1c2-2520-4aea-8a67-c57c01297213+7:14467:x1869977655306752:12345-192.168.204.36@tcp:101:bash.0 00010000:00010000:1.0:1783349923.306051:0:16265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349923.306079:0:16265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a4847795d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bf01 expref: -99 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783349923.306114:0:16265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a4bc2a1, atime: 0x6a4bc29f, ctime: 0x6a4bc2a1, blocks: 0x1 00010000:00010000:1.0:1783349923.306142:0:16265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1783349923.306147:0:16265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783349923.306159:0:16265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a4847795d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bf01 expref: 8 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.306176:0:16265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000249d1811/0x68b4a22a4847795d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bf01 expref: 8 pid: 16265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.306191:0:16265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102051c00, rc 0) 00000100:00100000:1.0:1783349923.306282:0:16265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e57dc1c2-2520-4aea-8a67-c57c01297213+8:14467:x1869977655306752:12345-192.168.204.36@tcp:101:bash.0 Request processed in 264us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349923.306291:0:16265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 19 00000100:00100000:3.0:1783349923.314695:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349923.318154:0:14143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655307008 00000100:00100000:0.0:1783349923.318177:0:14143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655307008 00000100:00100000:0.0:1783349923.318334:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 14 00000100:00100000:0.0:1783349923.318365:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+19:14467:x1869977655307008:12345-192.168.204.36@tcp:35:bash.0 00000001:00080000:0.0:1783349923.319878:0:14143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1783349923.320362:0:14143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1783349923.320780:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+22:14467:x1869977655307008:12345-192.168.204.36@tcp:35:bash.0 Request processed in 2411us (6092us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1783349923.320821:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 14 00000020:00080000:0.0:1783349923.320829:0:14143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783349923.556029:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349923.556163:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655307264 00000100:00100000:1.0:1783349923.556175:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655307264 00000100:00100000:1.0:1783349923.556252:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:1.0:1783349923.556265:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320faaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+22:14478:x1869977655307264:12345-192.168.204.36@tcp:101:lfs.0 00010000:00010000:1.0:1783349923.556299:0:14141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783349923.556324:0:14141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff932102051000/0x68b4a22a48477964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb02469a251b6bf08 expref: -99 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783349923.556731:0:14141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783349923.556995:0:14141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff932102051000/0x68b4a22a48477964 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bf08 expref: 24 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.557013:0:14141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9320c2913e00) 00010000:00010000:1.0:1783349923.557017:0:14141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783349923.557023:0:14141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff932102051000/0x68b4a22a48477964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.36@tcp remote: 0xb02469a251b6bf08 expref: 24 pid: 14141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783349923.557039:0:14141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff932102051000, rc 0) 00000100:00100000:1.0:1783349923.557264:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320faaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14478:x1869977655307264:12345-192.168.204.36@tcp:101:lfs.0 Request processed in 1000us (1248us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1783349923.557273:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 61 00000100:00100000:1.0:1783349923.571745:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349923.572074:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655307392 00000100:00100000:2.0:1783349923.572088:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655307392 00000100:00100000:2.0:1783349923.572177:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:2.0:1783349923.572190:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14478:x1869977655307392:12345-192.168.204.36@tcp:34:lfs.0 00010000:00010000:2.0:1783349923.572298:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.572320:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.572334:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.572352:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.572359:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.572365:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573050:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573064:0:14139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573073:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783349923.573132:0:14139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573269:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573276:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573283:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573289:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002200 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349923.573294:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573301:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573315:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9320c2913b00) 00010000:00010000:2.0:1783349923.573318:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349923.573323:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573330:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002200/0x68b4a22a48477972 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573345:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573352:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573364:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573369:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9003400 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349923.573372:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573379:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573388:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9320c3886300) 00010000:00010000:2.0:1783349923.573390:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349923.573393:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573399:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9003400/0x68b4a22a48477979 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573414:0:14139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573421:0:14139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573426:0:14139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573431:0:14139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9320c9002000 already unused, calling callback (ffffffffc21274f0) 00010000:00010000:2.0:1783349923.573446:0:14139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573477:0:14139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573487:0:14139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9320e0103d00) 00010000:00010000:2.0:1783349923.573490:0:14139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783349923.573493:0:14139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783349923.573498:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9320c9002000/0x68b4a22a48477980 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783349923.575382:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14478:x1869977655307392:12345-192.168.204.36@tcp:34:lfs.0 Request processed in 3178us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349923.575398:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 62 00000100:00100000:1.0:1783349923.582088:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349923.582187:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655307648 00000100:00100000:2.0:1783349923.582201:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655307648 00000100:00100000:2.0:1783349923.582281:0:14142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 15 00000100:00100000:2.0:1783349923.582293:0:14142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+23:14478:x1869977655307648:12345-192.168.204.36@tcp:35:lfs.0 00000100:00100000:2.0:1783349923.582945:0:14142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+24:14478:x1869977655307648:12345-192.168.204.36@tcp:35:lfs.0 Request processed in 651us (868us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1783349923.582955:0:14142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 15 00010000:00010000:3.0:1783349923.627181:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783349923.834892:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1783349923.834927:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1783349923.834937:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:1.0:1783349924.654006:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783349925.511595:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349925.511654:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349925.511686:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349925.511711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349925.511755:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308032 00000100:00100000:1.0:1783349925.511769:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308032 00000100:00100000:1.0:1783349925.511877:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:1.0:1783349925.511891:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2362:x1869977655308032:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349925.512003:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2362:x1869977655308032:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349925.512012:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 18 00000100:00100000:1.0:1783349925.512039:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655307904 00000100:00100000:1.0:1783349925.512043:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655307904 00000100:00100000:1.0:1783349925.512072:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308288 00000100:00100000:1.0:1783349925.512075:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308288 00000100:00100000:1.0:1783349925.512099:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349925.512105:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+24:2362:x1869977655307904:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349925.512142:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e57dc1c2-2520-4aea-8a67-c57c01297213+24:2362:x1869977655307904:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349925.512149:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 24 00000100:00100000:1.0:1783349925.512162:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00100000:1.0:1783349925.512168:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2362:x1869977655308288:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:1.0:1783349925.512196:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c6799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8a5277a-b365-42d1-8539-cd0a1e990d5e+6:2362:x1869977655308288:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349925.512202:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 25 00000100:00080000:1.0:1783349925.512223:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783349925.512229:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783349925.515638:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655307776 00000100:00100000:3.0:1783349925.515657:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655307776 00000100:00100000:3.0:1783349925.515761:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:3.0:1783349925.515772:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d170bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2362:x1869977655307776:12345-192.168.204.36@tcp:400:kworker.0 00000100:00100000:3.0:1783349925.515900:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d170bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbe73cc-1856-47c4-9e27-5609d833c88a+13:2362:x1869977655307776:12345-192.168.204.36@tcp:400:kworker.0 Request processed in 129us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349925.515908:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 120 00000100:00100000:2.0:1783349925.542940:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349925.543006:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:2.0:1783349925.543048:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:0.0:1783349925.543149:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308160 00000100:00100000:0.0:1783349925.543165:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308160 00000100:00100000:0.0:1783349925.543245:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308416 00000100:00100000:0.0:1783349925.543248:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308416 00000100:00100000:0.0:1783349925.543271:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308544 00000100:00100000:0.0:1783349925.543274:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308544 00000100:00100000:0.0:1783349925.543295:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1783349925.543305:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+5:2358:x1869977655308160:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:0.0:1783349925.543443:0:14774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48477615 00000100:00080000:0.0:1783349925.543466:0:14774:0:(import.c:65:import_set_state_nolock()) ffff9320f77db000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349925.543524:0:14774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1783349925.543953:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+2:2358:x1869977655308160:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 647us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349925.543963:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 20 00000100:00100000:0.0:1783349925.543984:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:0.0:1783349925.543993:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2358:x1869977655308416:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:0.0:1783349925.544009:0:14774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a48477646 00000100:00080000:0.0:1783349925.544017:0:14774:0:(import.c:65:import_set_state_nolock()) ffff9320fb14d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349925.544039:0:14774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:0.0:1783349925.544198:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+2:2358:x1869977655308416:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 206us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349925.544205:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 21 00000100:00100000:0.0:1783349925.544218:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 22 00000100:00100000:0.0:1783349925.544225:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c8610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+5:2358:x1869977655308544:12345-192.168.204.36@tcp:9:kworker.0 00000020:00000080:0.0:1783349925.544239:0:14774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x68b4a22a4847764d 00000100:00080000:0.0:1783349925.544246:0:14774:0:(import.c:65:import_set_state_nolock()) ffff9320fb148800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783349925.544261:0:14774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1783349925.544338:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c8610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8a5277a-b365-42d1-8539-cd0a1e990d5e+2:2358:x1869977655308544:12345-192.168.204.36@tcp:9:kworker.0 Request processed in 113us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349925.544442:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 22 00010000:00010000:1.0:1783349925.544708:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783349925.544994:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783349925.545000:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783349925.545160:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783349925.674180:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783349926.070124:0:16305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1783349926.492092:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:3.0:1783349926.492137:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.36@tcp (source: 12345-192.168.204.36@tcp) 00000100:00100000:1.0:1783349926.492359:0:14780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308672 00000100:00100000:1.0:1783349926.492370:0:14780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308672 00002000:00100000:1.0:1783349926.492498:0:14780:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9320ec483800 x1869977655308672/t0(0) o4->e57dc1c2-2520-4aea-8a67-c57c01297213@192.168.204.36@tcp:677/0 lens 504/0 e 0 to 0 dl 1783349937 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1783349926.492509:0:14780:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320ec483800 with x1869977655308672 ext(0->8) 00002000:00010000:1.0:1783349926.492527:0:14780:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320ec483800 00000100:00100000:1.0:1783349926.492622:0:14780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 0 00000100:00100000:1.0:1783349926.492634:0:14780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2362:x1869977655308672:12345-192.168.204.36@tcp:4:bash.0 00000100:00100000:1.0:1783349926.493270:0:14780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+8:2362:x1869977655308672:12345-192.168.204.36@tcp:4:bash.0 Request processed in 633us (1180us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783349926.493280:0:14780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 0 00002000:00100000:1.0:1783349926.493289:0:14780:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9320ec483800 x1869977655308672/t8589934598(0) o4->e57dc1c2-2520-4aea-8a67-c57c01297213@192.168.204.36@tcp:677/0 lens 504/448 e 0 to 0 dl 1783349937 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1783349926.493298:0:14780:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9320ec483800 with x1869977655308672 ext(0->8) 00002000:00010000:1.0:1783349926.493303:0:14780:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9320ec483800 00000100:00100000:0.0:1783349926.494990:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977655308800 00000100:00100000:0.0:1783349926.495007:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977655308800 00000100:00100000:0.0:1783349926.495085:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.36@tcp, seq: 23 00000100:00100000:0.0:1783349926.495094:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+8:2362:x1869977655308800:12345-192.168.204.36@tcp:16:kworker.0 00000001:00100000:1.0:1783349926.566715:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8a5277a-b365-42d1-8539-cd0a1e990d5e 00000020:00000080:1.0:1783349926.566728:0:6607:0:(genops.c:906:class_export_put()) final put ffff9320fb14b000/d8a5277a-b365-42d1-8539-cd0a1e990d5e 00000001:00080000:1.0:1783349926.566766:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:3.0:1783349926.567190:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320ec482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e57dc1c2-2520-4aea-8a67-c57c01297213+6:2362:x1869977655308800:12345-192.168.204.36@tcp:16:kworker.0 Request processed in 72089us (75044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783349926.567204:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.36@tcp, seq: 23 00000020:00000080:2.0:1783349926.567299:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fb14b000/d8a5277a-b365-42d1-8539-cd0a1e990d5e for lustre-OST0000 00000020:00000080:2.0:1783349926.567360:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320fb14d000 for lustre-OST0000 00010000:00010000:3.0:1783349926.698422:0:14128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783349926.762274:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783349926.762308:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c8612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666810112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349926.762428:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783349926.762541:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666810112 00000100:00100000:2.0:1783349926.762552:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666810112 00000100:00100000:2.0:1783349926.762630:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783349926.762642:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666810112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783349926.762679:0:14778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1783349926.762741:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666810112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783349926.762750:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783349926.762778:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783349926.762858:0:3292:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1783349926.762865:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9320ec480e00, transno 8589934595 00000004:00080000:2.0:1783349926.762876:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1783349926.762924:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c8612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666810112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783349926.762980:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320faaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666810240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783349926.763014:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349926.763731:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666810240 00000100:00100000:0.0:1783349926.763740:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666810240 00000100:00100000:0.0:1783349926.763836:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783349926.763852:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c750ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666810240:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783349926.763948:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1783349926.764029:0:14778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783349926.764324:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c750ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1869977666810240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 478us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349926.764333:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783349926.764399:0:3292:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320faaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1869977666810240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783349926.764912:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666810496:0@lo:400:kworker.0 00000100:00100000:1.0:1783349926.764972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349926.765009:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783349926.765016:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c679b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666810368:0@lo:400:kworker.0 00000100:00100000:1.0:1783349926.765057:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349926.765096:0:14141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666810496 00000100:00100000:1.0:1783349926.765103:0:14141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666810496 00000100:00100000:1.0:1783349926.765149:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783349926.765158:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666810496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349926.765207:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1869977666810496:12345-0@lo:400:kworker.0 Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349926.765216:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783349926.765251:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666810368 00000100:00100000:1.0:1783349926.765255:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666810368 00000100:00100000:1.0:1783349926.765283:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783349926.765290:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320d1709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666810368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783349926.765323:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320d1709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8+19:3294:x1869977666810368:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783349926.765329:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783349926.765367:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666810624:0@lo:400:kworker.0 00000100:00100000:1.0:1783349926.765409:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783349926.765432:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783349926.765439:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9320c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666810752:0@lo:400:kworker.0 00000100:00100000:1.0:1783349926.765466:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783349926.765900:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666810624 00000100:00100000:0.0:1783349926.765914:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666810624 00000100:00080000:3.0:1783349926.766861:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783349926.766918:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c679b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c03eaf5-3c01-4bdb-85d5-7a85e51946c8:3294:1869977666810368:0@lo:400:kworker.0 00000100:00100000:3.0:1783349926.766939:0:3294:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1869977666810496:0@lo:400:kworker.0 00000100:00100000:0.0:1783349926.770891:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869977666810752 00000100:00100000:0.0:1783349926.770925:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869977666810752 00000100:00100000:0.0:1783349926.771034:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349926.771047:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666810624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349926.771212:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1869977666810624:12345-0@lo:400:kworker.0 Request processed in 167us (5799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349926.771221:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783349926.771439:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783349926.771448:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9320c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666810752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783349926.771487:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9320c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1869977666810752:12345-0@lo:400:kworker.0 Request processed in 42us (6021us total) trans 0 rc 0/0 00000100:00100000:0.0:1783349926.771495:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1783349926.771510:0:14135:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783349926.771569:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1869977666810752:0@lo:400:kworker.0 00000100:00100000:2.0:1783349926.771588:0:3291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9320c4fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1869977666810624:0@lo:400:kworker.0 00000001:00100000:2.0:1783349926.860477:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8a5277a-b365-42d1-8539-cd0a1e990d5e 00000020:00000080:2.0:1783349926.860504:0:7491:0:(genops.c:906:class_export_put()) final put ffff9320fb14c800/d8a5277a-b365-42d1-8539-cd0a1e990d5e 00000001:00100000:2.0:1783349926.860541:0:7491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e57dc1c2-2520-4aea-8a67-c57c01297213 00000020:00000080:2.0:1783349926.860545:0:7491:0:(genops.c:906:class_export_put()) final put ffff9320f77dc800/e57dc1c2-2520-4aea-8a67-c57c01297213 00000020:00000080:0.0:1783349926.860611:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320fb14c800/d8a5277a-b365-42d1-8539-cd0a1e990d5e for lustre-OST0001 00000020:00000080:0.0:1783349926.860673:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9320f77dc800/e57dc1c2-2520-4aea-8a67-c57c01297213 for lustre-OST0001 00000020:00000080:0.0:1783349926.860691:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320fb148800 for lustre-OST0001 00000020:00000080:0.0:1783349926.860699:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9320f77db000 for lustre-OST0001 00010000:00010000:2.0:1783349927.723089:0:14127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28210 lines, 28210 kept, 0 dropped, 0 bad.